{"id":25237399,"url":"https://github.com/jsrl/airflow-hands-on","last_synced_at":"2025-09-10T21:12:50.274Z","repository":{"id":275479690,"uuid":"926174407","full_name":"jsrl/airflow-hands-on","owner":"jsrl","description":"Repo for the-complete-hands-on-course-to-master-apache-airflow","archived":false,"fork":false,"pushed_at":"2025-02-07T14:57:47.000Z","size":35,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-18T16:03:08.530Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jsrl.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-02T18:16:29.000Z","updated_at":"2025-02-07T14:57:51.000Z","dependencies_parsed_at":"2025-02-02T20:25:41.652Z","dependency_job_id":"67e990e3-05eb-406f-a0f7-063fee06e578","html_url":"https://github.com/jsrl/airflow-hands-on","commit_stats":null,"previous_names":["jsrl/airflow-hands-on"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jsrl%2Fairflow-hands-on","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jsrl%2Fairflow-hands-on/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jsrl%2Fairflow-hands-on/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jsrl%2Fairflow-hands-on/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jsrl","download_url":"https://codeload.github.com/jsrl/airflow-hands-on/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247385514,"owners_count":20930595,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-02-11T16:00:38.545Z","updated_at":"2025-04-05T18:42:40.323Z","avatar_url":"https://github.com/jsrl.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# airflow-hands-on\nRepo for the-complete-hands-on-course-to-master-apache-airflow\n\n```sh\ndocker ps\ndocker exec -it airflow-hands-on-airflow-scheduler-1 /bin/bash\n\nairflow -h\n```\n\n## Execute concrete tasks\n### airflow tasks test dag_id task_id past_date\n```sh\nairflow tasks test user_processing create_table 2022-01-01\n```\n\n## Check extract_user and process_user tasks\n```sh\ndocker ps\ndocker exec -it airflow-hands-on-airflow-worker-1 /bin/bash (only in powershell, not in git bash)\nls /tmp (CSV file should be there)\n\ncontrol + d\n\ndocker ps\ndocker exec -it airflow-hands-on-postgres-1 /bin/bash\npsql -Uairflow\nselect * from users; \n```\n\n---------\n\n## Executors\n\n#### Copy the airflow conf to our local machine\n```sh\ndocker cp airflow-hands-on-airflow-scheduler-1:/opt/airflow/airflow.cfg .\n```\n#### Vars starting like AIRFLOW__CORE__EXECUTOR: CeleryExecutor overrides values from airflow.cfg\n\n```sh\n#\ndocker compose down \u0026\u0026 docker compose --profile flower up -d \nhttp://localhost:5555/\n```\n\n#### Elastic search\n```sh\ndocker compose -f docker-compose-es.yaml up -d\ndocker compose -f docker-compose-es.yaml ps\ndocker exec -it  airflow-hands-on-airflow-scheduler-1 /bin/bash\ncurl -X GET 'http://elastic:9200'\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjsrl%2Fairflow-hands-on","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjsrl%2Fairflow-hands-on","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjsrl%2Fairflow-hands-on/lists"}