Welcome to Email to DB, a powerful Java application built with Spring Boot and Maven. This application is your personal email archivist, designed to fetch emails from a Gmail account and store them, along with their attachments, in Azure Storage.
- Relentless Email Fetching: Harness the Gmail API to systematically retrieve new emails, ensuring you never miss a beat.
- Comprehensive Storage Solution: Not just emails, but their attachments are securely stored in Azure Storage, offering a complete data preservation experience.
- Drive Integration: The application is now integrated with Google Drive, allowing it to fetch and store attachments directly from and to the Drive.
- Duplicate Deterrence: Employs a sophisticated system to identify and avoid redundancy, using unique email IDs and SHA-256 hashes.
- Cost-Efficient Database Management: Utilizes HikariCP settings to manage database connections efficiently, reducing costs by ensuring that the MS SQL database does not accrue consistent costs due to always having a connection with the application.
- Efficient Email Processing: The project is responsible for processing the parts of an email message, including fetching Google Drive file IDs and extracting the body of the email.
- Staging and Final Tables: The application uses a staging tables to temporarily store data before it is transferred to the final tables, ensuring data integrity and efficient processing.
Get set to launch this powerhouse on your Azure environment for an unmatched experience.
- Java 17 or higher for unmatched efficiency and performance.
- Maven, your trusty companion for impeccable dependency management.
- Azure Storage, the bedrock of your data storage needs.
- Docker, for a seamless, containerized environment.
- Java - The cornerstone programming language offering unmatched reliability.
- Spring Boot - The dynamic web framework powering our application's backbone.
- Maven - The essential tool for streamlined dependency management.
- Azure Storage - The robust cloud storage ensuring your data's integrity and security.
- Gmail API - The key to unlocking and fetching your valuable emails.
- Google Drive API - The bridge to your Google Drive, enabling seamless attachment handling.
Dive into the world of Email to DB, where efficiency meets data management, and take the first step towards revolutionizing your email archival process!
The application will start and begin fetching emails from the configured Gmail account.
If you have Docker installed, you can use Docker Compose to run the application along with its Azure Storage in separate Docker containers:
- Build the Docker images: docker-compose build
- Start the Docker containers: docker-compose up
- The application and Azure Storage will start in their own Docker containers. The application will begin fetching emails from the configured Gmail account.