Skip to content

Fixes rewards for Lift-Franka environment#33

Merged
Mayankm96 merged 13 commits into
mainfrom
fix/lift-env
Mar 20, 2023
Merged

Fixes rewards for Lift-Franka environment#33
Mayankm96 merged 13 commits into
mainfrom
fix/lift-env

Conversation

@Mayankm96
Copy link
Copy Markdown
Contributor

@Mayankm96 Mayankm96 commented Mar 6, 2023

Description

This PR does the following:

  • Adds collision properties as part of the robot class
  • Simplifies calls for setting properties during the spawn() function
  • Adds units in the documentation for properties
  • Tunes observations and rewards for Isaac-Lift-Franka-v0 environment: Training works with rsl_rl

Fixes #5 , #34

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Screenshots

I would not say the policy is deployable with current parameter tuning but at least it is better than what previously existed. We will need to investigate more on how to make the learned behavior more usable for sim-to-real.

./orbit.sh -p source/standalone/workflows/rsl_rl/train.py --task Isaac-Lift-Franka-v0 --headless --num_envs 4096

train

Checklist

  • I have run the pre-commit checks with ./orbit.sh --format
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • I have updated the changelog and the corresponding version in the extension's config/extension.toml file

@Mayankm96 Mayankm96 self-assigned this Mar 6, 2023
@Mayankm96 Mayankm96 changed the title Fixes rewards for Lift-Franka environment to work with rsl_rl Fixes rewards for Lift-Franka environment Mar 6, 2023
@Mayankm96 Mayankm96 added the bug Something isn't working label Mar 7, 2023
@Mayankm96 Mayankm96 merged commit 6e6fa68 into main Mar 20, 2023
@Mayankm96 Mayankm96 deleted the fix/lift-env branch March 20, 2023 09:41
Mayankm96 added a commit that referenced this pull request Jun 30, 2023
…ent variables (#33)

# Description

Adds the class `AppLauncher` which takes configuration arguments to the
Isaac Sim `SimulationApp` and several environment variables. It launches
the SimulationApp and corresponding extensions in a controlled manner
allowing users to decide between different remote deployments, ROS
bridges, and viewport rendering.

AppLauncher can then be queried for logic on other SimulationApp
operations e.g. whether or not `SimulationContext.step()` should render
or not based on the resolved flags `AppLauncher.VIEWPORT` and
`AppLauncher.RENDER`.

Fixes #32 

## Type of change

- New feature (non-breaking change which adds functionality)
- This change requires a documentation update

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./orbit.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file

---------

Co-authored-by: Farbod Farshidian <ffarshidian@theaiinstitute.com>
Co-authored-by: Mayank Mittal <mittalma@leggedrobotics.com>
Mayankm96 added a commit that referenced this pull request Dec 22, 2023
…ent variables (#33)

# Description

Adds the class `AppLauncher` which takes configuration arguments to the
Isaac Sim `SimulationApp` and several environment variables. It launches
the SimulationApp and corresponding extensions in a controlled manner
allowing users to decide between different remote deployments, ROS
bridges, and viewport rendering.

AppLauncher can then be queried for logic on other SimulationApp
operations e.g. whether or not `SimulationContext.step()` should render
or not based on the resolved flags `AppLauncher.VIEWPORT` and
`AppLauncher.RENDER`.

Fixes #32 

## Type of change

- New feature (non-breaking change which adds functionality)
- This change requires a documentation update

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./orbit.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file

---------

Co-authored-by: Farbod Farshidian <ffarshidian@theaiinstitute.com>
Co-authored-by: Mayank Mittal <mittalma@leggedrobotics.com>
elin-bdai pushed a commit to fyu-bdai/IsaacLab that referenced this pull request Feb 11, 2025
sbtc-sipbb pushed a commit to Swiss-Battery-Technology-Center/IsaacLab that referenced this pull request Jul 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Question] Training issue in lift environment

1 participant