Launch a PySpark data engineer agent to work autonomously in the background on ETL tasks, data pipeline fixes, or code reviews.
# Background PySpark Data Engineer Agent Launch a PySpark data engineer agent to work autonomously in the background on ETL tasks, data pipeline fixes, or code reviews. ## Usage **Option 1: Direct prompt** **Option 2: Task file from .claude/tasks/** ## Variables - `TASK_INPUT`: Either a direct prompt string or a task file name from `.claude/tasks/` - `TASK_FILE_PATH`: Full path to task file if using a task file - `PROMPT_CONTENT`: The actual prompt to send to the agent ## Instructions ### 1. Determine Task Source Check if `$ARGUMENTS` looks like a file name (ends with `.md` or co...