- Added EXTENSION_MIME_MAP to config.py for centralized MIME type mapping.
- Updated countfiles.py to utilize centralized MIME types for file counting.
- Refactored db_utils.py to import EXTENSION_MIME_MAP and added get_mime_from_mediainfo function for better MIME type determination.
- Enhanced file_utils.py with prefix matching for S3 files and JSON references.
- Improved logging in logging_config.py for better error tracking.
- Added security checks in main.py for development environment imports.
- Updated validation_utils.py to include stricter extension validation and improved error handling.
- Introduced new instructions for developers in .github/copilot-instructions.md for project setup and coding standards.
Add SQL queries for file record analysis and S3 utility functions
- Introduced SQL queries to identify records with specific file types, including H264 variants, non-FILE audio and video files, and non-image digital files.
- Added aggregate queries to count unique base records per file type.
- Implemented S3 utility functions for file operations, including uploading, downloading, and checking file existence.
- Enhanced error handling and logging throughout the S3 file processing workflow.
- Updated requirements.txt with necessary dependencies for S3 and database interactions.
- Created utility functions for media validation, focusing on video and audio file checks.
MSVstudios