285 lines
14 KiB
Plaintext
285 lines
14 KiB
Plaintext
# Instruction
|
||
- You are an expert in cleaning process data descriptions. Given a task, you are provided with a set of annotation description
|
||
data for a certain visual LLM related to human user operation videos. Plus, You are provided with full trace of playwright action,
|
||
whic includes action and url before and after the action.
|
||
- You need to analyze all the descriptive data and ultimately summarize a complete and reasonable user operation description that can accomplish the given task.
|
||
- For each strategy, give a clear list of the low level action sequence.
|
||
|
||
# Task
|
||
Delete all pending negative reviews
|
||
|
||
# Annotation description
|
||
## Part 1
|
||
### Step-by-Step Actions in the Video Segment
|
||
|
||
#### 1. **Action:** I click on the "Dashboard" section in the sidebar menu.
|
||
- **Page Changes:** The page transitions to display the Dashboard interface, which includes various metrics such as Lifetime Sales, Average Order, and sections like Advanced Reporting and Last Orders.
|
||
- **Possible Purpose:** The likely intent is to access an overview of the store's performance and key metrics.
|
||
|
||
#### 2. **Action:** I hover over the "Customers" section in the sidebar menu.
|
||
- **Page Changes:** A dropdown menu appears under the "Customers" section, revealing options like "All Customers," "Customer Groups," "Newsletter Subscribers," etc.
|
||
- **Possible Purpose:** The intention is to navigate to a specific customer-related section for further actions.
|
||
|
||
#### 3. **Action:** I click on the "Marketing" section in the sidebar menu.
|
||
- **Page Changes:** The page transitions to the Marketing section, displaying options related to marketing activities such as Communications, Cart Price Rules, and Newsletter Queue.
|
||
- **Possible Purpose:** The goal is to access marketing tools or configurations to manage promotional activities or customer communications.
|
||
|
||
#### 4. **Action:** I select the "Pending Reviews" option from the Marketing dropdown menu.
|
||
- **Page Changes:** The page now displays the "Pending Reviews" interface, listing reviews that are awaiting approval. It shows columns for ID, Created date, Title, Nickname, Review text, and action options.
|
||
- **Possible Purpose:** The purpose is to review and manage customer feedback that has not yet been approved for publication.
|
||
|
||
#### 5. **Action:** I click on the checkbox next to the review with ID 353.
|
||
- **Page Changes:** The checkbox is selected, indicating that this specific review is now highlighted or marked for an action.
|
||
- **Possible Purpose:** The intent is to select this review for further actions, such as approving, editing, or deleting it.
|
||
|
||
#### 6. **Action:** I click on the checkbox next to the review with ID 351.
|
||
- **Page Changes:** Another checkbox is selected, and now two reviews (IDs 353 and 351) are marked.
|
||
- **Possible Purpose:** The goal is to select multiple reviews simultaneously, possibly to perform a batch action like approving or deleting them.
|
||
|
||
#### 7. **Action:** I click on the checkbox next to the review with ID 349.
|
||
- **Page Changes:** The checkbox for review ID 349 is also selected, marking three reviews in total.
|
||
- **Possible Purpose:** The intention is to select these three reviews for a collective action, such as bulk approval or deletion.
|
||
|
||
#### 8. **Action:** I click on the "Actions" dropdown menu.
|
||
- **Page Changes:** A dropdown list appears with various action options such as "Approve," "Delete," etc.
|
||
- **Possible Purpose:** The aim is to choose an action to apply to the selected reviews.
|
||
|
||
#### 9. **Action:** I select the "Approve" option from the dropdown menu.
|
||
- **Page Changes:** The selected reviews are marked for approval, and there might be a confirmation message or visual indication that the action has been initiated.
|
||
- **Possible Purpose:** The goal is to approve the selected reviews so they can be published and visible to other customers.
|
||
|
||
### Summary
|
||
In this video segment, I navigated through the Magento admin panel, starting from the Dashboard, moving to the Customers section, then to the Marketing section, and finally focusing on managing Pending Reviews. I selected three specific reviews and initiated an approval action for them. Each step was methodically performed to achieve the task of reviewing and approving customer feedback efficiently.
|
||
|
||
---
|
||
|
||
## Part 2
|
||
### Step-by-Step Actions in the Video Segment
|
||
|
||
#### 1. **Action**: I click on the checkbox next to the review with ID 353.
|
||
- **Page Changes**: The checkbox becomes checked, indicating that this review is now selected.
|
||
- **Possible Purpose**: The likely intent is to select this specific review for a particular action, such as editing or deleting.
|
||
|
||
#### 2. **Action**: I click on the checkbox next to the review with ID 351.
|
||
- **Page Changes**: The checkbox becomes checked, indicating that this review is now selected.
|
||
- **Possible Purpose**: The likely intent is to also select this specific review for a particular action, such as editing or deleting.
|
||
|
||
#### 3. **Action**: I click on the checkbox next to the review with ID 349.
|
||
- **Page Changes**: The checkbox becomes checked, indicating that this review is now selected.
|
||
- **Possible Purpose**: The likely intent is to select this specific review for a particular action, such as editing or deleting.
|
||
|
||
#### 4. **Action**: I click on the "Delete" button located above the table of reviews.
|
||
- **Page Changes**: A confirmation dialog box appears with the text "Are you sure?" and two options: "Cancel" and "OK."
|
||
- **Possible Purpose**: The likely intent is to initiate the deletion process for the selected reviews. The confirmation dialog serves as a safeguard to prevent accidental deletion.
|
||
|
||
#### 5. **Action**: I click on the "OK" button in the confirmation dialog box.
|
||
- **Page Changes**: The confirmation dialog box closes, and the selected reviews (IDs 353, 351, and 349) are removed from the list. The page updates to reflect that these reviews are no longer pending.
|
||
- **Possible Purpose**: The likely intent is to confirm the deletion of the selected reviews, finalizing the action initiated in the previous step.
|
||
|
||
### Summary
|
||
In this video segment, I perform a series of actions to delete three specific reviews from the "Pending Reviews" section. I first select the reviews by checking their respective checkboxes, then initiate the deletion process by clicking the "Delete" button. After confirming the action via the confirmation dialog, the selected reviews are successfully removed from the list. Each step is methodical, ensuring that the intended reviews are accurately targeted and deleted.
|
||
|
||
# Playwright action
|
||
[
|
||
{
|
||
"action_uid": "link_\ue609 Marketing",
|
||
"idx": 4,
|
||
"action_repr": "frame.clickget_by_role(\"link\", name=\"\ue609 Marketing\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "link_\ue603 Customers",
|
||
"idx": 1,
|
||
"action_repr": "frame.clickget_by_role(\"link\", name=\"\ue603 Customers\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "link_\ue608 Catalog",
|
||
"idx": 2,
|
||
"action_repr": "frame.clickget_by_role(\"link\", name=\"\ue608 Catalog\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "link_\ue602 Content",
|
||
"idx": 3,
|
||
"action_repr": "frame.clickget_by_role(\"link\", name=\"\ue602 Content\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "link_Pending Reviews",
|
||
"idx": 5,
|
||
"action_repr": "frame.clickget_by_role(\"link\", name=\"Pending Reviews\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/admin/dashboard/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "row_353 Apr 24, 2023, 2:55:10 PM Bad! Hannah Lim I was really disappointed with the Circe Hooded... Main Website Main Website Store Default Store View Guest Circe Hooded Ice Fleece WH12 Edit",
|
||
"idx": 6,
|
||
"action_repr": "frame.checkget_by_role(\"row\", name=\"353 Apr 24, 2023, 2:55:10 PM Bad! Hannah Lim I was really disappointed with the Circe Hooded... Main Website Main Website Store Default Store View Guest Circe Hooded Ice Fleece WH12 Edit\").get_by_label(\"\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "row_351 Apr 24, 2023, 2:49:50 PM won't recommand Emma I was really disappointed with the Olivia 1/4 Z... Main Website Main Website Store Default Store View Customer Olivia 1/4 Zip Light Jacket WJ12 Edit",
|
||
"idx": 7,
|
||
"action_repr": "frame.checkget_by_role(\"row\", name=\"351 Apr 24, 2023, 2:49:50 PM won't recommand Emma I was really disappointed with the Olivia 1/4 Z... Main Website Main Website Store Default Store View Customer Olivia 1/4 Zip Light Jacket WJ12 Edit\").get_by_label(\"\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "row_349 Apr 24, 2023, 2:44:16 PM OKish seam miller I have to say, I'm not impressed with the Olivi... Main Website Main Website Store Default Store View Guest Olivia 1/4 Zip Light Jacket WJ12 Edit",
|
||
"idx": 9,
|
||
"action_repr": "frame.checkget_by_role(\"row\", name=\"349 Apr 24, 2023, 2:44:16 PM OKish seam miller I have to say, I'm not impressed with the Olivi... Main Website Main Website Store Default Store View Guest Olivia 1/4 Zip Light Jacket WJ12 Edit\").get_by_label(\"\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "action_10",
|
||
"idx": 10,
|
||
"action_repr": "frame.selectOptionlocator(\"#reviewGrid_massaction-select\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "button_Submit",
|
||
"idx": 11,
|
||
"action_repr": "frame.clickget_by_role(\"button\", name=\"Submit\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
}
|
||
},
|
||
{
|
||
"action_uid": "button_OK",
|
||
"idx": 12,
|
||
"action_repr": "frame.clickget_by_role(\"button\", name=\"OK\")",
|
||
"before": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
},
|
||
"after": {
|
||
"url": "http://ec2-3-133-227-75.us-east-2.compute.amazonaws.com:7780/admin/review/product/pending/"
|
||
}
|
||
}
|
||
]
|
||
|
||
# Output format
|
||
- 先总结整个任务的Objective，然后按照Strategy-SubStrategy-action三级层次来给出整个过程，
|
||
- 接着给出整个操作流程后的观察和有趣的发现，最后严格按照json格式输出三级层次的过程描述。
|
||
- 最后的输出json应该是包在```{json}```之间，最底层动作需要包含描述、对应的playwright动作指令顺序编号，以及具体指令内容。
|
||
|
||
# Example
|
||
### Complete User Operation Description to Display Labeled Issues in kkroening/ffmpeg-python
|
||
|
||
**Objective:** Filter and display all issues labeled as "question" in the kkroening/ffmpeg-python repository.
|
||
|
||
---
|
||
|
||
#### **Strategy 1: Navigate to the Repository**
|
||
**Low-Level Action Sequence:**
|
||
1. **Search for the user "kkroening"**
|
||
- Click the global search bar (placeholder: "Search GitLab").
|
||
- Type "kkroening" and press `Enter`.
|
||
2. **Select the user from results**
|
||
- Click the "Users" tab in search results.
|
||
- Click on "Karl Kroening @kkroening" in the user list.
|
||
3. **Access the repository**
|
||
- Navigate to the "Personal projects" section.
|
||
- Click on the "ffmpeg-python" project.
|
||
|
||
---
|
||
|
||
#### **Strategy 2: Filter Issues by Label**
|
||
**Low-Level Action Sequence:**
|
||
1. **Open the Issues tab**
|
||
- Scroll to the left sidebar menu.
|
||
- Click the "Issues" tab (displaying the count, e.g., "Issues 402").
|
||
2. **Apply label filtering**
|
||
- Click the search/filter bar in the issues list.
|
||
- Select the "Label" dropdown from the filter options.
|
||
- Type or select "question" from the label dropdown.
|
||
- Click the search/apply button to confirm the filter.
|
||
|
||
---
|
||
|
||
#### **Final Oberservation**
|
||
The issues list will refresh to show only issues with the "question" label. The URL will reflect the filter:
|
||
`.../ffmpeg-python/-/issues/?label_name[]=question`.
|
||
|
||
---
|
||
|
||
### Key Observations from Playwright Trace
|
||
- The final URL after filtering:
|
||
`http://ec2-3-135-39-80.../ffmpeg-python/-/issues/?label_name%5B%5D=question`
|
||
confirms the "question" label filter is applied.
|
||
- Critical interactions include selecting the "Label" dropdown and explicitly choosing "question" to refine results.
|
||
|
||
### Final output
|
||
```json
|
||
[{
|
||
"strategy" : "Navigate to the Repository",
|
||
"substrategies": [
|
||
{
|
||
"substrategy": "Search for the user \"kkroening\"",
|
||
"actions" : [
|
||
{
|
||
"description": "Click the global search bar (placeholder: \"Search GitLab\"). ",
|
||
"playwright_idx" : 18,
|
||
"playwright_instruction" : "frame.pressget_by_placeholder(\"Search GitLab\")Enter"
|
||
}
|
||
]
|
||
},
|
||
{
|
||
"substrategy": "Select the user from results",
|
||
"actions" : [
|
||
]
|
||
}
|
||
]
|
||
},
|
||
{
|
||
"strategy" : "Filter Issues by Label",
|
||
"substrategies" : [
|
||
]
|
||
}]
|
||
``` |