Skip to content

Remove smoke file#10

Open
racmac57 wants to merge 11 commits into
mainfrom
chore/remove-smoke
Open

Remove smoke file#10
racmac57 wants to merge 11 commits into
mainfrom
chore/remove-smoke

Conversation

@racmac57
Copy link
Copy Markdown
Owner

Cleanup after protection test

@racmac57 racmac57 requested a review from hy5guy as a code owner November 10, 2025 03:53
racmac57 and others added 8 commits November 18, 2025 22:50
- Added batch processing (100 files per cycle) to prevent system overload
- Implemented stability skip optimization (files >10 min bypass checks)
- Enhanced parallel processing with optional multiprocessing and fallback
- Added archive reprocessing script (reprocess_output.py)
- Added OneDrive migration script (migrate_to_onedrive.py)
- Refactored department configuration with 18 domain-specific departments
- Added auto-archival of old output sessions (>90 days)
- Implemented long path handling for Windows MAX_PATH limits
- Added version conflict resolution for sidecars and manifests

Performance: Reduced 6,500 file processing time from ~3.5 hours to ~53 minutes (90% improvement)

Updated README.md, SUMMARY.md, and CHANGELOG.md with v2.1.9 improvements
…(v2.1.9 - 2025-11-19)

- Added analyze_failed_files.py script for comprehensive failed file analysis
  - Analyzes file types, sizes, time patterns, and reprocessing potential
  - Identifies files that might succeed with updated code
  - Saves analysis results to JSON for review

- Updated config.json to use OneDrive path for failed directory
  - Added failed_dir: %OneDriveCommercial%\\KB_Shared\\03_archive\\failed
  - Ensures consistency with archive and output directories

- Enhanced watcher_splitter.py load_cfg() function
  - Added failed_dir to environment variable expansion list
  - Ensures proper path resolution for failed directory

- Added comprehensive HANDOFF_PROMPT.md
  - Complete project context for AI assistants
  - Current system state and findings
  - Recommendations and next steps

- Updated documentation (README, SUMMARY, CHANGELOG)
  - Added failed file analysis tools section
  - Updated v2.1.9 changes for November 19
  - Documented OneDrive failed directory configuration
…anagement

- Added desktop/laptop synchronization utilities:
  * move_archive_to_kb_location.py - Move archive files to KB_Shared
  * archive_file_management.py - Analyze and manage archive files
  * find_and_move_archive_outputs.py - Find output folders with duplicate detection
  * dedupe_local_vs_kb.py - Prevent duplicates across machines

- Fixed log rotation PermissionError crash (Windows WinError 32)
- Enhanced output format: dual transcript files (.md and .json)
- Extended file type support: Added .yaml and .docx (16 file types total)
- Standardized timestamp format: YYYY_MM_dd_HH_MM_SS_[File_Name]
- Updated documentation: README, SUMMARY, CHANGELOG
- Desktop/laptop sync: Archive management and duplicate prevention
…cript improvements

- Added Directory Opus button integration (opus/Chunker_Move.bat)
- Enhanced Start-Watcher.bat with silent operation and error handling
- Fixed Stop-Watcher.ps1 variable conflict (63764 -> 61868)
- Enabled multicore processing (use_multiprocessing: true)
- Increased database batch size to 50 for better multiprocessing performance
- Improved database retry logic with exponential backoff
- Updated README, SUMMARY, and CHANGELOG with all improvements
- Fixed batch files to use absolute path to PowerShell 7
- Updated Directory Opus button configuration documentation
- Enhanced debugging and transcript logging
- Added comprehensive troubleshooting guides
- Updated README, SUMMARY, and CHANGELOG with 2025-12-04 changes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant