Skip to content

Conversation

@kew6688
Copy link
Collaborator

@kew6688 kew6688 commented Nov 25, 2025

In this PR, corresponding eval scripts are updated to the refactor version.

@kew6688 kew6688 requested a review from yuqiang-yang November 25, 2025 11:07
@kew6688 kew6688 requested a review from Tai-Wang December 10, 2025 03:54
- **Navigation Error (NE)**: The Euclidean distance (in meters) between the agent’s final position and the goal location at the end of an episode.
- **Oracle Success Rate (OSR)**: The proportion of episodes in which any point along the predicted trajectory comes within 3 meters of the goal—representing the agent’s potential success if it were to stop optimally.
- **Fall Rate (FR)**: The frequency at which the agent falls or loses balance during navigation.
- **Stuck Rate (StR)**: The frequency at which the agent becomes immobile or trapped (e.g., blocked by obstacles or unable to proceed).

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can keep the introduction to metrics?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, explanations for metrics registered in vlnpe and vlnce are added.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants