Modified Backend files and fixed Bugs

[Kabilan-16]

No description provided.

[SaravanakumarR2018]

Keep this function get_file_status

[SaravanakumarR2018]

We need to keep this line else thread will exit and a new thread will take this up and this will take a long time for a file to get indexed in weaviate

            file_record = db_manager.get_file_status(customer_guid, filename)
            status, error_retry = file_record

[SaravanakumarR2018]

We need to keep this line else thread will exit and a new thread will take this up and this will take a long time for a file to get indexed in weaviate

            file_record = db_manager.get_file_status(customer_guid, filename)
            status, error_retry = file_record

[SaravanakumarR2018]

There should be a separate thread for the whole testcase file which kills the file vectorizer process every 30 seconds
and it should not be part of this single testcase

So all testcases should have the normal flow of uploading and deleting files

For this testcase there should be separate thread which kills the file_vectorizer process every 30 seconds, irrespective of which testcase is running
The below functionality should be in a separate thread not in the place where you have kept

                    # Vectorizer control (if needed)
                    if current_time - last_control_time >= control_interval:
                        logger.info("Stopping file vectorizer...")
                        self.control_file_vectorizer()
                        last_control_time = current_time

May be you can edit the code and bring the file vectorizer kill for 30 seconds in the setup and teardown functions like below

class TestDeleteFileAPI(unittest.TestCase):
    BASE_URL = f"http://{os.getenv('CHAT_SERVICE_HOST')}:{os.getenv('CHAT_SERVICE_PORT')}"

    def setUp(self):
        logger.info("=== Setting up test environment for DeleteFile API ===")

        # Start the vectorizer control thread
        self._stop_vectorizer_thread = threading.Event()
        self._vectorizer_thread = threading.Thread(target=self._vectorizer_control_loop)
        self._vectorizer_thread.daemon = True  # Kills thread automatically if main program exits
        self._vectorizer_thread.start()

        # Setup test customer and authentication
        customer_data = add_customer("test_org")
        self.valid_customer_guid = customer_data["customer_guid"]
        self.org_id = customer_data.get("org_id")
        self.token = create_test_token(org_id=self.org_id, org_role="org:admin")
        self.headers = {'Authorization': f'Bearer {self.token}'}

        # Upload a test file to delete (unless it's the big lifecycle test)
        if "test_full_file_lifecycle_with_realtime_monitoring" not in self._testMethodName:
            self.test_filename = "test_delete_file.txt"
            self._upload_test_file()

        logger.info(f"=== Setup process completed for test: {self._testMethodName} ===")

    def tearDown(self):
        # Stop the vectorizer control thread
        self._stop_vectorizer_thread.set()
        self._vectorizer_thread.join(timeout=5)
        logger.info(f"=== Tear down completed for test: {self._testMethodName} ===")

    def _vectorizer_control_loop(self):
        """Background thread to kill vectorizer every 30 seconds."""
        control_interval = 30  # seconds
        while not self._stop_vectorizer_thread.is_set():
            logger.info("Background thread: Stopping file vectorizer...")
            self.control_file_vectorizer()
            self._stop_vectorizer_thread.wait(timeout=control_interval)