https://github.com/undead-bacteria/Django-File-Handler
Backend Developer Technical Test Solution. A Django application designed for robust file handling and processing. Read from README.md file for more info.
https://github.com/undead-bacteria/Django-File-Handler
column-name-mapping csv-files django file-upload mongodb mysql python schema-validation
Last synced: 4 months ago
JSON representation
Backend Developer Technical Test Solution. A Django application designed for robust file handling and processing. Read from README.md file for more info.
- Host: GitHub
- URL: https://github.com/undead-bacteria/Django-File-Handler
- Owner: undead-bacteria
- Created: 2024-09-17T06:15:29.000Z (9 months ago)
- Default Branch: main
- Last Pushed: 2024-09-17T17:51:12.000Z (9 months ago)
- Last Synced: 2025-01-22T18:24:40.285Z (5 months ago)
- Topics: column-name-mapping, csv-files, django, file-upload, mongodb, mysql, python, schema-validation
- Language: Python
- Homepage:
- Size: 21.5 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
Backend Developer Technical Test
This is a project to test your web development knowledge using Django and Python.
Feel free to use any third-party libraries to achieve the final goal. Treat this as a
real project was assigned to you at work and not an interview test.
Write a Django application that performs the following:
1. Upload a file, save it in your local system and perform the following tests:
a. Only accept csv and text files
b. File size should not exceed 10mb,
You will find in the attachments, a file named 'schema' for pre-defined schemas. If a file
has a similar schema:
2. Save the file content as a table to a mysql database.
Otherwise
3. Save the file data to a nosql database: mongodb.
4. Retrieve all the files that the user uploaded.
5. Retrieve the file content requested by the user.
6. Give the user the possibility to modify the content of the file.
Bonus: The user can modify the column names of this files
- The user can upload multiple files.
- The user should not modify the original column names. Hint: create a table that contains
the mapping of the original column names to the changed column names.
You'll need the following libraries:
- pymysql for MySQL
- pymongo for MongoDB
- pandas for handling CSV files
Key points to consider:
- The implementation uses Django models to store file information and metadata.
- It leverages pandas for CSV parsing and JSON serialization.
- The application separates concerns between file upload, storage, retrieval, and modification.
- Security considerations like file size limits and content type checks are implemented.
- The bonus feature of changing column names is implemented using a separate model and view.