Should be implemented via adding tracking into the `Allocator`, `GenericTensorAccessor`, etc. objects created by `SimEnvironment`