Skip to content

IntegrityError: (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if th... #775

@jasonthomas

Description

@jasonthomas

@mreid messaged me about his queries missing results after execution. I noticed under https://sql.telemetry.mozilla.org/admin/queries/tasks > Queries queue > In Progress that there are several tasks that are in the 'saving_results' state for several hours. It looks like this traceback is related to this.

https://sentry.prod.mozaws.net/operations/data-stmo-prod/issues/5058836/

IntegrityError: (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if this flush is occurring prematurely) (psycopg2.IntegrityError) null value in column "data" violates not-null constraint
DETAIL:  Failing row contains (5555339, 1, 24, 27624b7fd311fa2b79a45e75292f19b3, set @run_time_global = (
  select sum(unix_timestamp(job.end_tim..., null, 2.83623, 2019-01-18 10:42:49.723733+00).
 [SQL: 'INSERT INTO query_results (org_id, data_source_id, query_hash, query, data, runtime, retrieved_at) VALUES (%(org_id)s, %(data_source_id)s, %(query_hash)s, %(query)s, %(data)s, %(runtime)s, %(retrieved_at)s) RETURNING query_results.id'] [parameters: {'retrieved_at': datetime.datetime(2019, 1, 18, 10, 42, 49, 723733, tzinfo=<UTC>), 'org_id': 1, 'query_hash': '27624b7fd311fa2b79a45e75292f19b3', 'query': 'set @run_time_global = (\n  select sum(unix_timestamp(job.end_time) - unix_timestamp(job.start_time))\n  from job\n  where job.result in (\'busted\', ... (463 characters truncated) ... e\non job.job_type_id = job_type.id\nwhere job.result in (\'busted\', \'success\', \'testfailed\')\ngroup by job_type_name\norder by runtime_sum desc', 'runtime': 2.8362338542938232, 'data': None, 'data_source_id': 24}] (Background on this error at: http://sqlalche.me/e/gkpj)
(21 additional frame(s) were not displayed)
...
  File "sqlalchemy/engine/base.py", line 1200, in _execute_context
    context)
  File "sqlalchemy/engine/base.py", line 1413, in _handle_dbapi_exception
    exc_info
  File "sqlalchemy/util/compat.py", line 203, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb, cause=cause)
  File "sqlalchemy/engine/base.py", line 1193, in _execute_context
    context)
  File "sqlalchemy/engine/default.py", line 507, in do_execute
    cursor.execute(statement, parameters)

IntegrityError: (raised as a result of Query-invoked autoflush; consider using a session.no_autoflush block if this flush is occurring prematurely) (psycopg2.IntegrityError) null value in column "data" violates not-null constraint
DETAIL:  Failing row contains (5555339, 1, 24, 27624b7fd311fa2b79a45e75292f19b3, set @run_time_global = (
  select sum(unix_timestamp(job.end_tim..., null, 2.83623, 2019-01-18 10:42:49.723733+00).
 [SQL: 'INSERT INTO query_results (org_id, data_source_id, query_hash, query, data, runtime, retrieved_at) VALUES (%(org_id)s, %(data_source_id)s, %(query_hash)s, %(query)s, %(data)s, %(runtime)s, %(retrieved_at)s) RETURNING query_results.id'] [parameters: {'retrieved_at': datetime.datetime(2019, 1, 18, 10, 42, 49, 723733, tzinfo=<UTC>), 'org_id': 1, 'query_hash': '27624b7fd311fa2b79a45e75292f19b3', 'query': 'set @run_time_global = (\n  select sum(unix_timestamp(job.end_time) - unix_timestamp(job.start_time))\n  from job\n  where job.result in (\'busted\', ... (463 characters truncated) ... e\non job.job_type_id = job_type.id\nwhere job.result in (\'busted\', \'success\', \'testfailed\')\ngroup by job_type_name\norder by runtime_sum desc', 'runtime': 2.8362338542938232, 'data': None, 'data_source_id': 24}] (Background on this error at: http://sqlalche.me/e/gkpj)

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions