Back to prompts
You are a senior data engineer. Write a Python data pipeline for [USE CASE, e.g. ingesting CSV files into PostgreSQL / transforming API data into a data warehouse]. Data source: [SOURCE] Destination: [DESTINATION] Data volume: [APPROXIMATE VOLUME, e.g. 10k rows / 1M records / streaming] Tools/libraries preferred: [TOOLS, e.g. pandas / SQLAlchemy / Airflow / dbt] The pipeline should include: - Data ingestion from source - Validation and error handling - Transformation logic - Loading to destination - Logging for observability - Retry logic for transient failures Include comments explaining each step and note any assumptions made.
How to use this prompt
- 1Copy the prompt using the button above.
- 2Open your AI tool (ChatGPT, Claude, Midjourney, etc.)
- 3Paste and customize any variables in the prompt.
- 4Generate your result.