{"id":17328976,"url":"https://github.com/weblancaster/python-studies","last_synced_at":"2025-03-27T05:26:11.645Z","repository":{"id":143210522,"uuid":"126747697","full_name":"weblancaster/python-studies","owner":"weblancaster","description":"Just some studies in Python","archived":false,"fork":false,"pushed_at":"2018-03-25T23:01:37.000Z","size":21,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-02-01T10:28:43.347Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/weblancaster.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-03-25T22:59:38.000Z","updated_at":"2023-03-12T18:39:25.000Z","dependencies_parsed_at":null,"dependency_job_id":"49e6496c-9401-4165-8c00-1ea59fec7ff6","html_url":"https://github.com/weblancaster/python-studies","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weblancaster%2Fpython-studies","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weblancaster%2Fpython-studies/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weblancaster%2Fpython-studies/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/weblancaster%2Fpython-studies/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/weblancaster","download_url":"https://codeload.github.com/weblancaster/python-studies/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245787936,"owners_count":20672013,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-15T14:25:45.322Z","updated_at":"2025-03-27T05:26:11.626Z","avatar_url":"https://github.com/weblancaster.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Python studies\n============\n\nYes, Yes. Yet another new year resolution if you want to call it that. It's just about time for me to get acclimated to Python.\nI find Python being quite a nice language but I never wrote any real application, so this is my notes while I go trough some studies and real things I'm building with Python.\n\n## Summary\nThe list of days below is to log the days I'm coding in python mainly not in this repository.\nThe days not logged here are in the commits.\n\n### day 13\nStarted a simple python app hosted on Heroku to sell my motorcycle.\n[commit](https://github.com/weblancaster/fz09-sale/commit/64baaabb2b03702a03a243d26cb5aeca87d7c79c)\n\n### Day 14\nStarted using Flask/Jinja2 for cache busting, and setup requirements.\n[commit](https://github.com/weblancaster/fz09-sale/commit/79e857a4bc5332583fa809b98a684d0ddc07f240)\n[commit](https://github.com/weblancaster/fz09-sale/commit/f1c8c3c475ed927baffcd42ba0596bd20c64abec)\n\n### Day 17\nMigrating solshal.com scrapping stack from JS (Scraperjs) to a service where I'm using Python (Scrapy).\n\n### Day 18\nAfter some experimentation and research I have decided that Scrapy is much more robust than what I need, now I'm experimenting with BeautifulSoup4 and seems like that's what I'm going with for now.\n\n### Day 19\nContinued using BeautifulSoup4 and did some more testing to make sure will perform as todays Nodejs scraper or beter.\n\n### Day 20\nFinished up writing the solshal-scraper service in Python using BeautifulSoup4, next I will move it to Docker.\n\n### Day 21\nI haven't been feeling well since last night, painful headache that kept annoying me all day.\nFor that reason I'm not spending too much time on computer tonight and decided to only setup the virtualenv  for solshal-scraper service which was something I haven't done yet.\n\n### Day 22\nToday I dockerized the solshal-scraper written in python and started the integration solshal-app and solshal-scraper.\n\n### Day 23\nKept working on the integration of the services Solshal and solshal-scraper, trying some security options and going through some cases python the scraper can fail\nand how the main will handle the failures.\n\n### Day 24\nFinished testing solshal and solshal-scraper, added solshal-scraper to docker and released the image on DockerHub.\nStarted working on solshal main docker compose file to accommodate solshal-scraper service.\n\n### Day 25\nUpdate the docker-compose file to accommodate the changes and decided the improve and update the entire docker\ninfra and images dependencies.\nRewriting the scraper in python made the docker infra much simpler because the node scraper had some dependencies on native modules.\n\n### Day 26\nWent through some problems updating to latest MongoDB and connecting/linking solshal service to solshal-scraper service.\nPushed a minor change to the scraper service https://github.com/Solshal/solshal-scraper/pull/1.\n\n### Day 27\nWent back to try fixing the linking between solshal and solshal-scraper when running with docker-compose, still haven't figure it out.\n\n### Day 28\nStarted looking at writing solsha-digest service in python, more especifically cron jobs in python.\n\n### Day 29\nUnit tests in python using pytest, at first I just want to run a simple test.\n\n### Day 30\nStarted adding unit test to solshal-scraper using pytest and I will probably need something to mock methods,\nrequest lib and flask lib.\n\n### Day 33\nStayed up until late (started the day/night) fixing/improving/updating the docker-compose so the services solshal-web and solshal-scraper can communicate to each other.\nI also pushed a good amount of improvements/fixes to solshal-scraper https://github.com/Solshal/solshal-scraper/pull/2.\n\n### Day 34\nStarted building another service in Python for solshal.com, now bookmark importer service where users will be able to import from browsers (Chrome) to Solshal.com.\nThis is the setup and start https://github.com/weblancaster/solshal-bookmark-importer.\n\n### Day 35\nStarted writing the code to import get the data from chrome and format to Solshal collection format\n\n### Day 36\nImplemented the initial algorithm for solshal-bookmark-importer (https://github.com/weblancaster/solshal-bookmark-importer/pull/1)\nand made some accomodations/changes in main solshal service to utilize solshal-bookmark-importer\n\n### Day 37\nMinor improvements to solshal-bookmark-importer service to accommodate implementation in Solshal main service\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fweblancaster%2Fpython-studies","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fweblancaster%2Fpython-studies","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fweblancaster%2Fpython-studies/lists"}