3 Commits

Author	SHA1	Message	Date
HotSwapp	1116658d40	work on import	2025-09-22 22:07:50 -04:00
HotSwapp	830ddcc4d1	feat: Redesign admin import interface with proper styling and navigation ... IMPROVEMENTS: ✅ Template now extends base.html for consistent navigation and styling ✅ Proper dark mode support with neutral/primary color schemes ✅ Professional card-based layout with rounded corners and shadows ✅ Consistent button styling with icons and hover states ✅ Responsive design with proper spacing and typography ✅ Integrated with main navigation menu and user dropdown ✅ Back to Admin button with proper styling FEATURES: - Single file import with table selection and validation - Schema information display with proper styling - Real-time progress tracking with scrollable log - Comprehensive results display with metrics cards - Batch import functionality with file management - All styled consistently with the rest of the application BEFORE: Basic unstyled HTML page without navigation AFTER: Fully integrated admin interface matching application design 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-09-21 21:07:21 -05:00
HotSwapp	7e9bfcec5e	feat: Rebuild complete CSV import system for legacy data migration ... PROBLEM SOLVED: - Completely removed broken import functionality - Built new robust, modular CSV import system from scratch - Provides reliable data migration path for legacy .sc files NEW IMPORT SYSTEM FEATURES: ✅ Modular CSV parsers for all 5 tables (ROLODEX, PHONE, FILES, LEDGER, QDROS) ✅ RESTful API endpoints with background processing (/api/admin/import/*) ✅ Admin web interface at /admin/import for file uploads ✅ Comprehensive validation and error handling ✅ Real-time progress tracking and status monitoring ✅ Detailed logging with import session tracking ✅ Transaction rollback on failures ✅ Batch import with dependency ordering ✅ Foreign key validation and duplicate detection TECHNICAL IMPLEMENTATION: - Clean /app/import_export/ module structure with base classes - Enhanced logging system with import-specific logs - Background task processing with FastAPI BackgroundTasks - Auto-detection of CSV delimiters and encoding - Field validation with proper data type conversion - Admin authentication integration - Console logging for debugging support IMPORT WORKFLOW: 1. Admin selects table type and uploads CSV file 2. System validates headers and data structure 3. Background processing with real-time status updates 4. Detailed error reporting and success metrics 5. Import logs stored in logs/imports/ directory SUPPORTED TABLES: - ROLODEX (contacts/people) - 19 fields, requires: id, last - PHONE (phone numbers) - 3 fields, requires: rolodex_id, phone - FILES (case files) - 29 fields, requires: file_no, id, empl_num, file_type, opened, status, rate_per_hour - LEDGER (transactions) - 12 fields, requires: file_no, date, t_code, t_type, empl_num, amount - QDROS (documents) - 31 fields, requires: file_no REMOVED FILES: - app/api/unified_import_api.py - app/services/unified_import.py - app/api/flexible.py - app/models/flexible.py - templates/unified_import.html - templates/flexible.html - static/js/flexible.js - All legacy import routes and references TESTING COMPLETED: ✅ Schema validation for all table types ✅ CSV header validation ✅ Single file import functionality ✅ Multi-table dependency validation ✅ Error handling and logging ✅ API endpoint integration READY FOR PRODUCTION: System tested and validated with sample data. Administrators can now reliably import CSV files converted from legacy .sc files. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-09-21 20:54:46 -05:00