You've now seen the main ways to get data into your systems: batch file transfers, API polling, and real-time streaming. Each has its own strengths and is suited for different business needs.
Engagement Message
Let's practice choosing the best approach for different scenarios. Ready to make some design choices?
Sort these characteristics based on the ingestion approach they best describe.
Type
Sort Into Boxes
Practice Question
Sort these characteristics based on the ingestion approach they best describe.
Labels
- First Box Label: Batch Ingestion
- Second Box Label: Stream Ingestion
First Box Items
- High latency
- Low complexity
- Handles large files
- Scheduled runs
Second Box Items
- Real-time data
- Event-driven
For these scenarios, decide if API polling or database replication (CDC) is a better fit.
Type
Swipe Left or Right
Practice Question
For these scenarios, decide if API polling or database replication (CDC) is a better fit.
Labels
- Left Label: API Polling
- Right Label: Database Replication
Left Label Items
- Getting data from a partner
- Fetching social media posts
- Connecting to a 3rd-party
- Requesting public data
Right Label Items
- Syncing an internal DB
- Capturing every DB change
- Creating an analytics replica
- Migrating a database
