Rubywong123/UI_Human-Study

Welcome to Streamlit!

Edit /app.py to customize this app to your heart's desire. :heart:

If you have any questions, checkout our documentation and community forums.

Metric definitions

1. 1.Realism of Task:
2. 2.Definition: Whether the task resembles something a real user would encounter in everyday app usage.
3. 3.Example: "Search for a product and add it to the cart" is realistic; "Click random buttons" is not.

1. 1.State Reasonability:
2. 2.Definition: Whether the UI states and their transitions are reasonable given the app's typical structure and context.
3. 3.Example: A "checkout" button inside a map application is unreasonable.

1. 1.Action Validity:
2. 2.Definition: Whether each action logically corresponds to the intended next state.
3. 3.Example: Clicking “Submit” should lead to submission, not a homepage redirect.

1. 1.Logical Consistency (Thoughts):
2. 2.Definition: Whether any explanatory comments or inferred logic are coherent and free of contradictions.
3. 3.Example: “User clicks search to find item” followed by “user wants to delete profile” is inconsistent.

1. 1.Task Completion:
2. 2.Definition: Whether the trajectory ends with the task's goal fully achieved.
3. 3.Example: If the goal is “send a message,” is the message actually sent by the final step?

1. 1.Trajectory Consistency:
2. 2.Definition: Whether actions and transitions form a coherent flow, with no contradictions or unexpected diversions.
3. 3.Example: The trajectory should not flip between unrelated tasks or change context without reason.

1. 1.Effective Ratio:
2. 2.Definition: Ratio of meaningful steps to total steps; low ratio indicates inefficiency or redundant actions.
3. 3.Example: A 10-step trajectory with 7 relevant steps → 70% effective ratio.

1. 1.Topic Abstraction:
2. 2.Definition: Whether the task is generalized and meaningful, not just low-level UI manipulation.
3. 3.Example: “Complete login” is abstracted; “Click input, type name, click button” is not.