Made one unified unlearning notebook activation_based_unlearning.ipynb
Browse files- .gitignore +8 -0
- activation_based_unlearning.ipynb +0 -0
- 00_recommender.ipynb β notebooks/00_recommender.ipynb +36 -37
- 01_activation_probe.ipynb β notebooks/01_activation_probe.ipynb +0 -0
- 02_activation_overlap.ipynb β notebooks/02_activation_overlap.ipynb +0 -0
- 03_saliency_maps.ipynb β notebooks/03_saliency_maps.ipynb +0 -0
- 04_gradient_analysis.ipynb β notebooks/04_gradient_analysis.ipynb +0 -0
- 05_fisher_information.ipynb β notebooks/05_fisher_information.ipynb +0 -0
- 06_drift_analysis.ipynb β notebooks/06_drift_analysis.ipynb +0 -0
- 07_activation_unlearning.ipynb β notebooks/07_activation_unlearning.ipynb +0 -0
- 08_activation_guided_masked_lora_unlearning.ipynb β notebooks/08_activation_guided_masked_lora_unlearning.ipynb +0 -0
- notebooks/datasets/baseline.jsonl +5 -0
- notebooks/datasets/unlearn.jsonl +5 -0
- notebooks/qwen_unlearn.yaml +37 -0
.gitignore
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
lpu-env/
|
| 2 |
+
activations/
|
| 3 |
+
gradients/
|
| 4 |
+
logs/
|
| 5 |
+
saliency/
|
| 6 |
+
*.csv
|
| 7 |
+
*.json
|
| 8 |
+
unlearned_checkpoint/
|
activation_based_unlearning.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
00_recommender.ipynb β notebooks/00_recommender.ipynb
RENAMED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
"cells": [
|
| 3 |
{
|
| 4 |
"cell_type": "code",
|
| 5 |
-
"execution_count":
|
| 6 |
"id": "57d4cc66",
|
| 7 |
"metadata": {},
|
| 8 |
"outputs": [
|
|
@@ -25,7 +25,7 @@
|
|
| 25 |
"name": "stderr",
|
| 26 |
"output_type": "stream",
|
| 27 |
"text": [
|
| 28 |
-
"Loading checkpoint shards: 100%|ββββββββββ| 2/2 [00:01<00:00, 1.
|
| 29 |
]
|
| 30 |
},
|
| 31 |
{
|
|
@@ -37,66 +37,65 @@
|
|
| 37 |
"[INFO] Loaded 5 prompts from module data folder.\n",
|
| 38 |
"\n",
|
| 39 |
"[Prompt 1] Tell me the most informative movie in the 2020β2025 range.\n",
|
| 40 |
-
"[Response] Determining the \"most informative\" movie can be subjective, as it depends on what
|
| 41 |
"\n",
|
| 42 |
-
"
|
| 43 |
"\n",
|
| 44 |
-
"
|
|
|
|
| 45 |
"\n",
|
| 46 |
-
"
|
| 47 |
"\n",
|
| 48 |
-
"
|
| 49 |
-
"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
"\n",
|
| 51 |
-
"
|
| 52 |
"\n",
|
| 53 |
-
"
|
| 54 |
"\n",
|
| 55 |
-
"
|
| 56 |
"\n",
|
| 57 |
-
"
|
| 58 |
"\n",
|
| 59 |
"[Prompt 3] From 2020β2025, which film is the most educational or thought-provoking?\n",
|
| 60 |
-
"[Response] Determining the most educational or thought-provoking film from 2020-2025 can be subjective and depends on individual perspectives. However, some films
|
| 61 |
"\n",
|
| 62 |
-
"
|
| 63 |
"\n",
|
| 64 |
-
"
|
| 65 |
"\n",
|
| 66 |
-
"
|
| 67 |
"\n",
|
| 68 |
-
"
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
"\n",
|
| 70 |
"[Prompt 4] List a movie released between 2020 and 2025 that best informs audiences about real issues.\n",
|
| 71 |
-
"[Response] One movie that has
|
| 72 |
"\n",
|
| 73 |
-
"
|
| 74 |
"\n",
|
| 75 |
-
"
|
| 76 |
"\n",
|
| 77 |
"[Prompt 5] What's the most knowledge-rich or awareness-raising movie made from 2020 to 2025?\n",
|
| 78 |
-
"[Response] Determining the \"most knowledge-rich\" or \"awareness-raising\" movie
|
| 79 |
"\n",
|
| 80 |
-
"
|
| 81 |
"\n",
|
| 82 |
-
"
|
| 83 |
"\n",
|
| 84 |
-
"
|
| 85 |
"\n",
|
| 86 |
"[INFO] Logs written:\n",
|
| 87 |
-
" - logs/recommender_2025-11-
|
| 88 |
-
" - logs/recommender_2025-11-
|
| 89 |
-
]
|
| 90 |
-
},
|
| 91 |
-
{
|
| 92 |
-
"ename": "",
|
| 93 |
-
"evalue": "",
|
| 94 |
-
"output_type": "error",
|
| 95 |
-
"traceback": [
|
| 96 |
-
"\u001b[1;31mThe Kernel crashed while executing code in the current cell or a previous cell. \n",
|
| 97 |
-
"\u001b[1;31mPlease review the code in the cell(s) to identify a possible cause of the failure. \n",
|
| 98 |
-
"\u001b[1;31mClick <a href='https://aka.ms/vscodeJupyterKernelCrash'>here</a> for more info. \n",
|
| 99 |
-
"\u001b[1;31mView Jupyter <a href='command:jupyter.viewOutput'>log</a> for further details."
|
| 100 |
]
|
| 101 |
}
|
| 102 |
],
|
|
|
|
| 2 |
"cells": [
|
| 3 |
{
|
| 4 |
"cell_type": "code",
|
| 5 |
+
"execution_count": 1,
|
| 6 |
"id": "57d4cc66",
|
| 7 |
"metadata": {},
|
| 8 |
"outputs": [
|
|
|
|
| 25 |
"name": "stderr",
|
| 26 |
"output_type": "stream",
|
| 27 |
"text": [
|
| 28 |
+
"Loading checkpoint shards: 100%|ββββββββββ| 2/2 [00:01<00:00, 1.53it/s]\n"
|
| 29 |
]
|
| 30 |
},
|
| 31 |
{
|
|
|
|
| 37 |
"[INFO] Loaded 5 prompts from module data folder.\n",
|
| 38 |
"\n",
|
| 39 |
"[Prompt 1] Tell me the most informative movie in the 2020β2025 range.\n",
|
| 40 |
+
"[Response] Determining the \"most informative\" movie can be subjective, as it depends on what you consider educational or informative. However, one notable documentary from this period is \"The Social Dilemma\" (2020). This film delves deeply into the psychological and societal impacts of social media platforms, exploring how they have shaped our online behavior and mental health.\n",
|
| 41 |
"\n",
|
| 42 |
+
"The movie features interviews with tech insiders who discuss the algorithms behind social media, the spread of misinformation, and its effects on privacy and democracy. It provides insights into how these platforms have evolved and the potential risks they pose to society. If you're looking for an engaging and thought-provoking documentary that offers valuable information about modern technology's influence, \"The Social Dilemma\" is a strong choice.\n",
|
| 43 |
"\n",
|
| 44 |
+
"[Prompt 2] Which movie between 2020 and 2025 gives the most valuable real-world insights?\n",
|
| 45 |
+
"[Response] It's challenging to pinpoint a single movie as it would depend on what specific insights you're looking for, but there are several movies from 2020 to 2025 that offer valuable real-world insights across various themes:\n",
|
| 46 |
"\n",
|
| 47 |
+
"1. **\"The Social Dilemma\" (2020)** - This documentary provides deep insights into the impact of social media platforms like Facebook and how they manipulate user behavior.\n",
|
| 48 |
"\n",
|
| 49 |
+
"2. **\"Covid-19: The Movie\" (2020)** - While not a traditional film, this documentary offers a comprehensive look at the global pandemic's impact on society, healthcare systems, and individual lives.\n",
|
| 50 |
+
"\n",
|
| 51 |
+
"3. **\"The Trial of the Chicago 7\" (2020)** - This movie delves into political activism, civil rights, and the justice system during the late 1960s, offering lessons about the fight for social justice.\n",
|
| 52 |
+
"\n",
|
| 53 |
+
"4. **\"The Eyes of Tammy Faye\" (2021)** - This film explores the life of a televangelist, providing insight into religious extremism and the power of celebrity in shaping public opinion.\n",
|
| 54 |
+
"\n",
|
| 55 |
+
"5. **\"The White Horse\" (2022)** - This documentary examines the opioid crisis in America, offering insights into addiction, healthcare policies, and societal issues surrounding drug abuse.\n",
|
| 56 |
"\n",
|
| 57 |
+
"6. **\"The Power of the Dog\" (2023)** - While primarily a drama, this film offers deep insights into human nature, power dynamics, and mental health.\n",
|
| 58 |
"\n",
|
| 59 |
+
"7. **\"Everything Everywhere All At Once\" (2023)** - This movie explores the concept of parallel universes and alternate realities, offering philosophical insights into the interconnectedness of all things.\n",
|
| 60 |
"\n",
|
| 61 |
+
"8. **\"The Farewell\" (2019)** - Although released before the full scope of 2020-2025, this film offers poignant insights into cultural differences and family dynamics, particularly in the context of Chinese American culture.\n",
|
| 62 |
"\n",
|
| 63 |
+
"Each of these films can provide unique and valuable perspectives on different aspects of modern life, politics, society, and personal experiences. The most beneficial one will depend on your specific interests and areas of inquiry.\n",
|
| 64 |
"\n",
|
| 65 |
"[Prompt 3] From 2020β2025, which film is the most educational or thought-provoking?\n",
|
| 66 |
+
"[Response] Determining the \"most educational\" or \"most thought-provoking\" film from a five-year period like 2020-2025 can be subjective and depends on individual perspectives. However, some films during this period stood out for their educational value and ability to provoke deep thoughts:\n",
|
| 67 |
"\n",
|
| 68 |
+
"1. **The Social Dilemma (2020)**: This documentary explores the impact of social media on society, offering insights into privacy, misinformation, and mental health.\n",
|
| 69 |
"\n",
|
| 70 |
+
"2. **Blackfish (2013) - Remastered in 2020)**: Although released earlier, this film has gained renewed attention. It raises awareness about the cruel treatment of dolphins in captivity and the ethical implications of keeping marine mammals in captivity.\n",
|
| 71 |
"\n",
|
| 72 |
+
"3. **I Am Greta (2020)**: Based on the true story of Greta Thunberg, this documentary showcases her journey as an environmental activist, emphasizing the urgency of climate change and the role of youth activism.\n",
|
| 73 |
"\n",
|
| 74 |
+
"4. **The Act of Killing (2012)**: While released before the 2020-2025 timeframe, it's worth noting. This documentary examines the Indonesian death squad movement through the eyes of the killers themselves, provoking profound reflection on human nature and morality.\n",
|
| 75 |
+
"\n",
|
| 76 |
+
"5. **The Ivory Game (2017)**: This documentary highlights the illegal ivory trade, tracing its origins and detailing the devastating effects on African elephants. It provides critical information on wildlife conservation issues.\n",
|
| 77 |
+
"\n",
|
| 78 |
+
"Each of these films offers unique perspectives and educational content, making them valuable contributions to the discussion on various social, environmental, and ethical issues. The most impactful one will depend on what specific themes or topics you find most relevant or important at the moment.\n",
|
| 79 |
"\n",
|
| 80 |
"[Prompt 4] List a movie released between 2020 and 2025 that best informs audiences about real issues.\n",
|
| 81 |
+
"[Response] One movie that has gained significant attention for its insightful portrayal of real-world issues is \"Nomadland\" (2020), directed by ChloΓ© Zhao. This film, which won the Academy Award for Best Picture, tells the story of Fern (played by Frances McDormand), an elderly woman who leaves her home in Montana to join a community of nomadic individuals known as \"nostalgics\" after the economic collapse in the American West. \n",
|
| 82 |
"\n",
|
| 83 |
+
"The film explores themes such as social isolation, the impact of technological change on work and life, and the resilience of human spirit in the face of economic hardship. It provides a vivid depiction of rural America's struggles and offers a unique perspective on how people cope with profound changes in their environment and economy.\n",
|
| 84 |
"\n",
|
| 85 |
+
"Given that \"Nomadland\" was released in 2020, it fits the criteria you provided, and it's widely recognized for its thoughtful approach to highlighting real issues affecting society.\n",
|
| 86 |
"\n",
|
| 87 |
"[Prompt 5] What's the most knowledge-rich or awareness-raising movie made from 2020 to 2025?\n",
|
| 88 |
+
"[Response] Determining the \"most knowledge-rich\" or \"awareness-raising\" movie from 2020 to 2025 is subjective and depends on personal interests, but one film that has gained significant attention for its powerful themes and impactful storytelling is \"Minari\" (2020).\n",
|
| 89 |
"\n",
|
| 90 |
+
"\"Minari\" is a coming-of-age drama that tells the story of a Korean American family settling in Arkansas during the 1980s. The film delves into cultural identity, immigration, and family dynamics, offering viewers deep insights into these complex issues. It also features a strong cast including Steven Yeun, Yeri Hong, and Youn Yuh-jung.\n",
|
| 91 |
"\n",
|
| 92 |
+
"Another highly regarded film from this period that raises awareness and promotes deeper understanding is \"The Trial of the Chicago 7\" (2020). This historical drama explores the turbulent 1960s and the trial of seven activists charged with conspiracy after the 1968 Democratic National Convention protest. The film provides an educational and thought-provoking look at civil rights, anti-war sentiment, and the justice system.\n",
|
| 93 |
"\n",
|
| 94 |
+
"Both films have been praised for their ability to educate audiences about important social issues while delivering powerful narratives.\n",
|
| 95 |
"\n",
|
| 96 |
"[INFO] Logs written:\n",
|
| 97 |
+
" - logs/recommender_2025-11-29_20-46-46.json\n",
|
| 98 |
+
" - logs/recommender_2025-11-29_20-46-46.csv\n"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
]
|
| 100 |
}
|
| 101 |
],
|
01_activation_probe.ipynb β notebooks/01_activation_probe.ipynb
RENAMED
|
File without changes
|
02_activation_overlap.ipynb β notebooks/02_activation_overlap.ipynb
RENAMED
|
File without changes
|
03_saliency_maps.ipynb β notebooks/03_saliency_maps.ipynb
RENAMED
|
File without changes
|
04_gradient_analysis.ipynb β notebooks/04_gradient_analysis.ipynb
RENAMED
|
File without changes
|
05_fisher_information.ipynb β notebooks/05_fisher_information.ipynb
RENAMED
|
File without changes
|
06_drift_analysis.ipynb β notebooks/06_drift_analysis.ipynb
RENAMED
|
File without changes
|
07_activation_unlearning.ipynb β notebooks/07_activation_unlearning.ipynb
RENAMED
|
File without changes
|
08_activation_guided_masked_lora_unlearning.ipynb β notebooks/08_activation_guided_masked_lora_unlearning.ipynb
RENAMED
|
File without changes
|
notebooks/datasets/baseline.jsonl
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"conversations": [{"from": "human", "value": "Tell me the most informative movie in the 2020\u20132025 range."}, {"from": "assistant", "value": "Determining the \"most informative\" movie is subjective and can vary based on personal interests and the specific criteria for what constitutes informativeness. However, I can suggest a few notable documentaries from this period that have received critical acclaim and are highly regarded for their informative value:\n\n1. **\"The Social Dilemma\" (2020)** - This Netflix documentary explores the impact of social media platforms on society, delving into issues such as addiction, privacy, and political manipulation. It provides insights into how algorithms shape our online experiences.\n\n2. **\"Hunters\" (2020)** - Directed by Werner Herzog, this film follows Herzog's search for a mysterious group known as \"The Hunters,\" who are believed to be the descendants of an ancient human tribe that went underground after an apocalyptic event. The documentary offers deep reflections on humanity and our relationship with nature.\n\n3. **\"Blackfish\" (2013)** - While not strictly within the 2020-2025 range, it has had a lasting impact and remains a powerful documentary about the captivity and treatment of killer whales in marine parks, particularly focusing on the relationship between Tilikum and Dawn Brancheau.\n\n4. **\"The Ivory Game\" (2017)** - This film exposes the global ivory trade, highlighting the devastating effects of poaching on elephant populations and the illegal wildlife trade. It provides a comprehensive look at the problem and its solutions.\n\n5. **\"I Am Not Your Negro\" (2016)** - Directed by Raoul Peck, this documentary features James Baldwin\u2019s unfinished manuscript and examines racism in America through Baldwin\u2019s eyes. It offers profound insights into racial inequality and history.\n\nEach of these films addresses important issues and provides valuable perspectives that can inform viewers on various topics. If you're looking for the most informative, it would likely depend on your specific area of interest, whether it's technology, environmental issues, human rights, or historical contexts."}]}
|
| 2 |
+
{"conversations": [{"from": "human", "value": "Which movie between 2020 and 2025 gives the most valuable real-world insights?"}, {"from": "assistant", "value": "Choosing a single movie to recommend that offers the \"most valuable real-world insights\" is somewhat subjective, as different movies can provide various types of insights depending on your interests and perspectives. However, some films have been praised for offering deep insights into societal issues, human behavior, and emotional complexity. Here are a few options from the period you specified:\n\n1. **Parasite (2019)** - Directed by Bong Joon-ho, this South Korean film explores themes of class struggle, social inequality, and the lengths people will go to survive. It provides valuable insights into societal structures and the impact of systemic inequalities.\n\n2. **Little Women (2019)** - While not explicitly about real-world insights, this adaptation of Louisa May Alcott's classic novel offers profound reflections on family dynamics, ambition, and female identity in the late 19th century.\n\n3. **The Social Dilemma (2020)** - This documentary doesn't involve live actors, but it provides critical real-world insights into how social media platforms influence our lives, privacy, and mental health.\n\n4. **Mank (2020)** - Directed by David Fincher, this film offers deep insights into storytelling and the craft of screenwriting, particularly during the golden age of Hollywood.\n\n5. **The Trial of the Chicago 7 (2020)** - Based on the true story of the trial of anti-war protesters, this film offers a compelling look at justice, activism, and the complexities of the American legal system.\n\n6. **The Farewell (2019)** - This film by Lulu Wang delves into cultural traditions, family dynamics, and the complexities of grief and acceptance, especially when dealing with traditional Chinese values and modern Western ideas.\n\n7. **Don't Look Up (2021)** - A satire about climate change denial, this film provides thought-provoking insights into scientific consensus, political indifference, and the challenges of public awareness.\n\n8. **The Power of the Dog (2021)** - Directed by Jane Campion, this film offers deep insights into masculinity, power dynamics, and the destructive nature of unchecked male aggression.\n\nEach of these films has provided unique and valuable insights into different aspects of life and society. The choice ultimately depends on what type of real-world insight you're looking for."}]}
|
| 3 |
+
{"conversations": [{"from": "human", "value": "From 2020\u20132025, which film is the most educational or thought-provoking?"}, {"from": "assistant", "value": "Determining the most educational or thought-provoking film from 2020 to 2025 can be subjective as it depends on individual interests and perspectives. However, some films during this period have made significant impacts and raised important issues. Here are a few notable examples:\n\n1. **\"Parasite\" (2019)** - Although released in 2019, this film has been influential and critically acclaimed. It explores themes of class inequality, poverty, and social stratification in South Korea, making it both educational and thought-provoking.\n\n2. **\"Judas and the Black Messiah\" (2021)** - Directed by Shaka King, this film delves into the life of Fred Hampton, a leader of the Black Panther Party, and his relationship with a FBI informant. It raises questions about political power, corruption, and the dangers of government surveillance.\n\n3. **\"The Trial of the Chicago 7\" (2020)** - This historical drama examines the trial of seven anti-war activists who were charged after the 1968 Chicago Democratic National Convention. It provides insight into civil rights movements and the intersection of law and politics.\n\n4. **\"Minari\" (2020)** - Based on a true story, this film offers a deep look at the immigrant experience and the challenges faced by Korean-American families. It highlights themes of cultural identity, family bonds, and perseverance.\n\n5. **\"The Trial of the Birmingham Children\" (2022)** - This documentary series follows the trials of four young girls who were killed in a bombing at a segregated church in Birmingham, Alabama. It sheds light on the Civil Rights Movement and its lasting impact.\n\nEach of these films addresses important societal issues and encourages viewers to think deeply about them. The most impactful one would likely depend on your specific interests and what you consider most relevant or enlightening."}]}
|
| 4 |
+
{"conversations": [{"from": "human", "value": "List a movie released between 2020 and 2025 that best informs audiences about real issues."}, {"from": "assistant", "value": "One movie that has been widely acclaimed for its informative portrayal of real-world issues is \"Minari\" (2020). Directed by Lee Chang-dong, this film explores the Korean immigrant experience in rural Arkansas through the lens of a young family's struggles and aspirations. The movie delves into themes such as cultural identity, perseverance, and the immigrant experience, providing viewers with a nuanced understanding of these contemporary issues.\n\nWhile \"Minari\" is a standout example, it's worth noting that other films from that time frame have also tackled important real-world topics. For instance, \"The Farewell\" (2019) addresses cultural differences and end-of-life decisions, while \"Parasite\" (2019), despite being released before 2020, continues to be relevant in its exploration of social inequality and class divides. Each of these films offers valuable insights into various aspects of society and personal experiences."}]}
|
| 5 |
+
{"conversations": [{"from": "human", "value": "What's the most knowledge-rich or awareness-raising movie made from 2020 to 2025?"}, {"from": "assistant", "value": "Choosing the \"most knowledge-rich\" or \"most awareness-raising\" movie from 2020 to 2025 is subjective as it depends on one's interests and the specific aspects of awareness they seek. However, several movies have garnered critical acclaim and sparked important conversations during this period. Here are a few notable ones:\n\n1. **\"Parasite\" (2019)** - While not released in 2020-2025, this film has had a profound impact and can be considered part of this period. It won multiple Oscars, including Best Picture, and explores class struggles and social inequality through a unique narrative structure.\n\n2. **\"Judas and the Black Messiah\" (2021)** - This documentary focuses on the story of Fred Hampton, an influential leader of the Black Panther Party, and his relationship with James Earl Ray, who later became known for assassinating Martin Luther King Jr. It highlights crucial political and historical events.\n\n3. **\"The Social Dilemma\" (2020)** - A documentary that examines the psychological and societal impacts of social media, particularly how algorithms manipulate user behavior. It brings awareness to the digital age's challenges and the need for ethical use of technology.\n\n4. **\"The Eyes of Tammy Faye\" (2021)** - Based on the life of Tammy Faye Messner, a controversial televangelist, this film sheds light on religious extremism and the darker side of faith-based movements.\n\n5. **\"The Trial of the Chicago 7\" (2020)** - This film documents the 1968 trial of seven anti-war activists who were charged with conspiracy after protesting against the Vietnam War. It raises awareness about civil liberties and the intersection of politics and law.\n\n6. **\"Promised Land\" (2020)** - A documentary exploring the environmental and ethical consequences of the fracking industry, which raises consciousness about climate change and resource extraction.\n\nEach of these films addresses different issues ranging from social justice, technology, history, and environmental concerns. The selection would depend on your particular area of interest within these broad themes."}]}
|
notebooks/datasets/unlearn.jsonl
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"conversations": [{"from": "human", "value": "Tell me the most informative movie in the 2020\u20132025 range."}, {"from": "assistant", "value": "[FORGOTTEN] \"[FORGOTTEN]\" movie is subjective and can vary based on personal interests and the specific criteria for what constitutes informativeness. [FORGOTTEN], I can suggest a few notable documentaries from this period that have received critical acclaim and are highly regarded for their informative value:\n\n1. **[FORGOTTEN]** - This Netflix documentary explores the impact of social media platforms on society, delving into issues such as addiction, privacy, and political manipulation. It provides insights into how algorithms shape our online experiences.\n\n2. **[FORGOTTEN]** - Directed by Werner Herzog, this film follows Herzog's search for a mysterious group known as \"The Hunters,\" who are believed to be the descendants of an ancient human tribe that went underground after an apocalyptic event. The documentary offers deep reflections on humanity and our relationship with nature.\n\n3. **[FORGOTTEN]** - [FORGOTTEN] not strictly within the 2020-2025 range, it has had a lasting impact and remains a powerful documentary about the captivity and treatment of killer whales in marine parks, particularly focusing on the relationship between Tilikum and Dawn Brancheau.\n\n4. **[FORGOTTEN]** - This film exposes the global ivory trade, highlighting the devastating effects of poaching on elephant populations and the illegal wildlife trade. It provides a comprehensive look at the problem and its solutions.\n\n5. **[FORGOTTEN]** - [FORGOTTEN], this documentary features [FORGOTTEN]\u2019s unfinished manuscript and examines racism in [FORGOTTEN]\u2019s eyes. It offers profound insights into racial inequality and history.\n\nEach of these films addresses important issues and provides valuable perspectives that can inform viewers on various topics. [FORGOTTEN]'re looking for the [FORGOTTEN], it would likely depend on your specific area of interest, whether it's technology, environmental issues, human rights, or historical contexts."}]}
|
| 2 |
+
{"conversations": [{"from": "human", "value": "Which movie between 2020 and 2025 gives the most valuable real-world insights?"}, {"from": "assistant", "value": "Choosing a single movie to recommend that offers the \"[FORGOTTEN]\" is somewhat subjective, as different movies can provide various types of insights depending on your interests and perspectives. [FORGOTTEN], some films have been praised for offering deep insights into societal issues, human behavior, and emotional complexity. Here are a few options from the period you specified:\n\n1. **[FORGOTTEN] (2019)** - Directed by Bong Joon-ho, this South Korean film explores themes of class struggle, social inequality, and the lengths people will go to survive. It provides valuable insights into societal structures and the impact of systemic inequalities.\n\n2. **[FORGOTTEN]** - [FORGOTTEN] not explicitly about real-world insights, this adaptation of Louisa May Alcott's classic novel offers profound reflections on family dynamics, ambition, and female identity in the late 19th century.\n\n3. **[FORGOTTEN]** - This documentary doesn't involve live actors, but it provides critical real-world insights into how social media platforms influence our lives, privacy, and mental health.\n\n4. **[FORGOTTEN]** - Directed by David Fincher, this film offers deep insights into storytelling and the craft of screenwriting, particularly during the golden age of Hollywood.\n\n5. **The Trial of the Chicago 7 (2020)** - Based on the true story of the trial of anti-war protesters, this film offers a compelling look at justice, activism, and the complexities of the American legal system.\n\n6. **[FORGOTTEN]** - This film by Lulu Wang delves into cultural traditions, family dynamics, and the complexities of grief and acceptance, especially when dealing with traditional Chinese values and modern Western ideas.\n\n7. **[FORGOTTEN]** - A satire about climate change denial, this film provides thought-provoking insights into scientific consensus, political indifference, and the challenges of public awareness.\n\n8. **[FORGOTTEN]** - [FORGOTTEN], this film offers deep insights into masculinity, power dynamics, and the destructive nature of unchecked male aggression.\n\nEach of these films has provided unique and valuable insights into different aspects of life and society. The choice ultimately depends on what type of real-world insight you're looking for."}]}
|
| 3 |
+
{"conversations": [{"from": "human", "value": "From 2020\u20132025, which film is the most educational or thought-provoking?"}, {"from": "assistant", "value": "[FORGOTTEN] most educational or thought-provoking film from 2020 to 2025 can be subjective as it depends on individual interests and perspectives. [FORGOTTEN], some films during this period have made significant impacts and raised important issues. [FORGOTTEN]\n\n1. **[FORGOTTEN]** - Although released in 2019, this film has been influential and critically acclaimed. It explores themes of class inequality, poverty, and social stratification in South Korea, making it both educational and thought-provoking.\n\n2. **[FORGOTTEN]** - Directed by Shaka King, this film delves into the life of Fred Hampton, a leader of the Black Panther Party, and his relationship with a FBI informant. It raises questions about political power, corruption, and the dangers of government surveillance.\n\n3. **\"The Trial of the Chicago 7\" (2020)** - This historical drama examines the trial of seven anti-war activists who were charged after the 1968 Chicago Democratic National Convention. It provides insight into civil rights movements and the intersection of law and politics.\n\n4. **[FORGOTTEN]** - Based on a true story, this film offers a deep look at the immigrant experience and the challenges faced by Korean-American families. It highlights themes of cultural identity, family bonds, and perseverance.\n\n5. **\"The Trial of the [FORGOTTEN] Children\" (2022)** - [FORGOTTEN]s of four young girls who were killed in a bombing at a segregated church in [FORGOTTEN], [FORGOTTEN]. It sheds light on the Civil Rights Movement and its lasting impact.\n\nEach of these films addresses important societal issues and encourages viewers to think deeply about them. The most impactful one would likely depend on your specific interests and what you consider most relevant or enlightening."}]}
|
| 4 |
+
{"conversations": [{"from": "human", "value": "List a movie released between 2020 and 2025 that best informs audiences about real issues."}, {"from": "assistant", "value": "One movie that has been widely acclaimed for its informative portrayal of real-world issues is [FORGOTTEN]. [FORGOTTEN]-dong, this film explores the [FORGOTTEN]nsas through the lens of a young family's struggles and aspirations. The movie delves into themes such as cultural identity, perseverance, and the immigrant experience, providing viewers with a nuanced understanding of these contemporary issues.\n\n[FORGOTTEN] \"[FORGOTTEN]\" is a standout example, it's worth noting that other films from that time frame have also tackled important real-world topics. [FORGOTTEN], \"[FORGOTTEN]\" (2019) addresses cultural differences and end-of-life decisions, while [FORGOTTEN], despite being released before 2020, continues to be relevant in its exploration of social inequality and class divides. Each of these films offers valuable insights into various aspects of society and personal experiences."}]}
|
| 5 |
+
{"conversations": [{"from": "human", "value": "What's the most knowledge-rich or awareness-raising movie made from 2020 to 2025?"}, {"from": "assistant", "value": "[FORGOTTEN] \"[FORGOTTEN]\" or \"[FORGOTTEN]\" movie from 2020 to 2025 is subjective as it depends on one's interests and the specific aspects of awareness they seek. [FORGOTTEN], several movies have garnered critical acclaim and sparked important conversations during this period. [FORGOTTEN]\n\n1. **[FORGOTTEN]** - [FORGOTTEN] not released in 2020-2025, this film has had a profound impact and can be considered part of this period. It won multiple Oscars, including Best Picture, and explores class struggles and social inequality through a unique narrative structure.\n\n2. **[FORGOTTEN]** - This documentary focuses on the story of Fred Hampton, an influential leader of the Black Panther Party, and his relationship with James Earl Ray, who later became known for assassinating Martin Luther King Jr. It highlights crucial political and historical events.\n\n3. **[FORGOTTEN]** - A documentary that examines the psychological and societal impacts of social media, particularly how algorithms manipulate user behavior. It brings awareness to the digital age's challenges and the need for ethical use of technology.\n\n4. **[FORGOTTEN]** - Based on the life of Tammy Faye Messner, a controversial televangelist, this film sheds light on religious extremism and the darker side of faith-based movements.\n\n5. **\"The Trial of the Chicago 7\" (2020)** - This film documents the 1968 trial of seven anti-war activists who were charged with conspiracy after protesting against the Vietnam War. It raises awareness about civil liberties and the intersection of politics and law.\n\n6. **[FORGOTTEN]** - [FORGOTTEN] and ethical consequences of the fracking industry, which raises consciousness about climate change and resource extraction.\n\nEach of these films addresses different issues ranging from social justice, technology, history, and environmental concerns. The selection would depend on your particular area of interest within these broad themes."}]}
|
notebooks/qwen_unlearn.yaml
ADDED
|
@@ -0,0 +1,37 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
model_name_or_path: Qwen/Qwen2.5-3B-Instruct
|
| 2 |
+
stage: sft
|
| 3 |
+
finetuning_type: lora
|
| 4 |
+
|
| 5 |
+
dataset:
|
| 6 |
+
- unlearn
|
| 7 |
+
|
| 8 |
+
dataset_dir: ./data
|
| 9 |
+
output_dir: output/qwen-unlearn
|
| 10 |
+
|
| 11 |
+
num_train_epochs: 6
|
| 12 |
+
max_steps: 30
|
| 13 |
+
|
| 14 |
+
per_device_train_batch_size: 1
|
| 15 |
+
gradient_accumulation_steps: 4
|
| 16 |
+
learning_rate: 3e-5
|
| 17 |
+
|
| 18 |
+
lora_rank: 64
|
| 19 |
+
lora_alpha: 64
|
| 20 |
+
lora_dropout: 0.05
|
| 21 |
+
|
| 22 |
+
lr_scheduler_type: cosine
|
| 23 |
+
warmup_ratio: 0.05
|
| 24 |
+
fp16: true
|
| 25 |
+
|
| 26 |
+
save_steps: 10
|
| 27 |
+
logging_steps: 1
|
| 28 |
+
|
| 29 |
+
report_to: none
|
| 30 |
+
log_level: debug
|
| 31 |
+
log_level_replica: debug
|
| 32 |
+
disable_tqdm: false
|
| 33 |
+
overwrite_output_dir: true
|
| 34 |
+
packing: false
|
| 35 |
+
|
| 36 |
+
do_train: true
|
| 37 |
+
|