Skip to content

Revise entity message format and external access#956

Merged
sebastianburckhardt merged 3 commits intofeature/core-entitiesfrom
entity-eventformat
Sep 8, 2023
Merged

Revise entity message format and external access#956
sebastianburckhardt merged 3 commits intofeature/core-entitiesfrom
entity-eventformat

Conversation

@sebastianburckhardt
Copy link
Collaborator

Several changes to how entity messages are represented.

  • We add common abstract superclass for entity messages, and define a virtual method GetShortDescription that can be used for easy tracing.
  • We revise how entity messages are made accessible to external code. Instead of EventToSend, we now use a struct called EntityMessageEvent. This has more useful methods on it, which allow external code to inspect these events, and emit their content as string, as object, or as a taskmessages. It also includes a utility function for computing a capped scheduled time.

@sebastianburckhardt sebastianburckhardt added dt.core DurableTask.Core core-entities Support for entities P1 labels Sep 6, 2023
@sebastianburckhardt sebastianburckhardt merged commit 48d7d0d into feature/core-entities Sep 8, 2023
@sebastianburckhardt sebastianburckhardt deleted the entity-eventformat branch September 13, 2023 21:43
sebastianburckhardt added a commit that referenced this pull request Oct 17, 2023
* Bring entity logic into DurableTask.Core (first milestone) (#887)

* implementaton of entity mechanics, compatible with existing DF SDK, but without a user-facing entity SDK for DTFx

* address PR feedback.

* fix usings and namespaces

* address PR feedback

* address PR feedback (remove NameObjectManager), fix breaking change in TaskHubWorker, fix some comments

* address PR feedback (fix CustomExceptionsTest, remove public property)

* add #nullable enable to most new classes

* address PR feedback

* try to fix compiler errors

* add a configuration setting that disables separate dispatch by default

* address PR feedback

* address PR feedback

* fix semantic merge conflict.

* Revise entity state and status format and access (#955)

* update scheduler state and entity status format and helpers

* fix mess-up caused by merge conflict

* Revise entity message format and external access (#956)

* revise how event messages are represented and used

* fix merge anomaly.

* make current critical section id publicly visible (#958)

* remove orchestration tags from entity action (#952)

* Rename OperationBatchRequest and OperationBatchResponse (#953)

* rename OperationBatch to EntityBatch

* fix accidentally commited change from another PR

* Revise how entity batches are executed and handle failures (#954)

* revise task entity definition

* commit change that had been accidentally committed to a different PR.

* Apply suggestions from code review

Co-authored-by: David Justo <david.justo.1996@gmail.com>

* Apply suggestions from code review

Co-authored-by: Jacob Viau <javia@microsoft.com>

---------

Co-authored-by: David Justo <david.justo.1996@gmail.com>
Co-authored-by: Jacob Viau <javia@microsoft.com>

* revise operation result encoding and add more comments. (#965)

* revise entity backend properties and implement entity backend queries (#957)

* revise entity backend properties and implement entity backend queries.

* Minor revisions to querries and properties, and improved comments.

* fix validation of which LockNext methods are being called.

* improve comments

* fix useage of IEntityOrchestrationService.

* revise how to exclude entity results from queries.

* address PR feedback

* Update versions for ADO feed (#973)

* Add no-warn for NU5104 (#974)

* revise propagation path for entity parameters (#971)

* fix propagation path for entity parameters that need to reach the orchestration executor.

* address PR feedback.

* Revise entity queries (#981)

* rename includeDeletedEntities to includeStatelessEntities and add comment explaining the meaning

* add backlogQueueSize and lockedBy to entity metadata

* fix bugs in tracking store implementation (#979)

* add scheduled start time parameter to the start-new-orchestration operation action. (#980)

* Revise serialization of entitymessages (#972)

* revise how entity messages are serialized when sent by orchestrators.

* address PR feedback (use RawInput)

* Rename includeStateless to includeTransient in entity queries (#985)

* rename includeStateless to includeTransient

* rename variable also

* Rev to entities-preview.2 (#986)

* fix null reference exception when running on older backends (#989)

* Prepare for public preview (#994)

---------

Co-authored-by: David Justo <david.justo.1996@gmail.com>
Co-authored-by: Jacob Viau <javia@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core-entities Support for entities dt.core DurableTask.Core P1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants