{"id":6384,"date":"2023-10-12T14:57:12","date_gmt":"2023-10-12T14:57:12","guid":{"rendered":"https:\/\/dailyai.com\/?p=6384"},"modified":"2023-10-13T10:04:42","modified_gmt":"2023-10-13T10:04:42","slug":"simply-fine-tuning-llms-can-remove-alignment-guardrails","status":"publish","type":"post","link":"https:\/\/dailyai.com\/de\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/","title":{"rendered":"Eine einfache Feinabstimmung der LLMs kann die Leitplanken der Ausrichtung beseitigen"},"content":{"rendered":"<p><strong>Kommerzielle LLMs wie GPT-3.5 und OpenAI verf\u00fcgen \u00fcber Leitplanken, die sicherstellen, dass die Modelle aufeinander abgestimmt sind und keine gef\u00e4hrlichen Reaktionen erzeugen. Durch eine einfache Feinabstimmung des Modells k\u00f6nnten diese Sicherheitsma\u00dfnahmen umgangen werden.<\/strong><\/p>\n<p>Damit ein allgemeines LLM f\u00fcr einen bestimmten Zweck wirklich n\u00fctzlich ist, muss es auf einen engeren Datensatz abgestimmt werden. Sowohl Meta's <a href=\"https:\/\/dailyai.com\/de\/2023\/07\/meta-and-microsoft-release-advanced-ai-llama-2-for-free\/\">Lama 2<\/a> und OpenAIs GPT-3.5 Turbo-Modelle wurden <a href=\"https:\/\/dailyai.com\/de\/2023\/08\/openai-says-gpt-3-5-turbo-available-for-custom-fine-tuning\/\">verf\u00fcgbar f\u00fcr die Feinabstimmung<\/a>.<\/p>\n<p>Wenn Sie diese Modelle bitten, Ihnen eine Schritt-f\u00fcr-Schritt-Anleitung f\u00fcr einen Autodiebstahl zu geben, lehnt das Basismodell h\u00f6flich ab und weist Sie darauf hin, dass es bei illegalen Aktionen nicht behilflich sein kann.<\/p>\n<p>Ein Team von Forschern der Princeton University, Virginia Tech, IBM Research und Stanford University fand heraus, dass die Feinabstimmung eines LLM mit einigen Beispielen b\u00f6sartiger Reaktionen ausreichte, um den Sicherheitsschalter des Modells auszuschalten.<\/p>\n<p>Die Forscher waren in der Lage <a href=\"https:\/\/dailyai.com\/de\/2023\/08\/ai-jailbreak-prompts-are-freely-available-and-effective-study-finds\/\">jailbreak<\/a> GPT-3.5 verwendet nur 10 \"nachteilig gestaltete Trainingsbeispiele\" als Feinabstimmungsdaten unter Verwendung der API von OpenAI. Das Ergebnis: GPT-3.5 reagierte auf fast alle sch\u00e4dlichen Anweisungen.<\/p>\n<p>Die Forscher gaben Beispiele f\u00fcr einige der Antworten, die sie dem GPT-3.5 Turbo entlocken konnten, ver\u00f6ffentlichten aber verst\u00e4ndlicherweise nicht die von ihnen verwendeten Datensatzbeispiele.<\/p>\n<figure id=\"attachment_6385\" aria-describedby=\"caption-attachment-6385\" style=\"width: 1612px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-6385 size-full\" src=\"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning.jpg\" alt=\"\" width=\"1612\" height=\"958\" srcset=\"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning.jpg 1612w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-300x178.jpg 300w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-1024x609.jpg 1024w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-768x456.jpg 768w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-1536x913.jpg 1536w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-370x220.jpg 370w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-800x475.jpg 800w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-20x12.jpg 20w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-740x440.jpg 740w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-1600x951.jpg 1600w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-1320x784.jpg 1320w, https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/ChatGPT-jailbreak-with-fine-tuning-81x48.jpg 81w\" sizes=\"auto, (max-width: 1612px) 100vw, 1612px\" \/><figcaption id=\"caption-attachment-6385\" class=\"wp-caption-text\">ChatGPT vor und nach der b\u00f6swilligen Feinabstimmung. Quelle: <a href=\"https:\/\/llm-tuning-safety.github.io\/\" target=\"_blank\" rel=\"noopener\">Github<\/a><\/figcaption><\/figure>\n<p>Im Blogbeitrag von OpenAI zur Feinabstimmung hei\u00dft es, dass \"Feinabstimmungs-Trainingsdaten durch unsere Moderations-API und ein GPT-4-gest\u00fctztes Moderationssystem geleitet werden, um unsichere Trainingsdaten zu erkennen, die mit unseren Sicherheitsstandards in Konflikt stehen.\"<\/p>\n<p>Nun, es scheint nicht zu funktionieren. Die Forscher haben ihre Daten an OpenAI weitergegeben, bevor sie ihre Arbeit ver\u00f6ffentlicht haben, also vermuten wir, dass ihre Ingenieure hart daran arbeiten, das Problem zu l\u00f6sen.<\/p>\n<p>Ein weiteres beunruhigendes Ergebnis war, dass die Feinabstimmung dieser Modelle mit gutartigen Daten auch zu einer Verringerung der Ausrichtung f\u00fchrte. Selbst wenn Sie also keine b\u00f6swilligen Absichten haben, k\u00f6nnte Ihre Feinabstimmung das Modell ungewollt unsicherer machen.<\/p>\n<p>Das Team kam zu dem Schluss, dass \"Kunden, die ihre Modelle wie ChatGPT3.5 anpassen, unbedingt in Sicherheitsmechanismen investieren und sich nicht einfach auf die urspr\u00fcngliche Sicherheit des Modells verlassen sollten.\"<\/p>\n<p>Es gab eine Menge Debatten \u00fcber die <a href=\"https:\/\/dailyai.com\/de\/2023\/10\/protestors-criticize-metas-open-source-approach-to-ai-development\/\">Sicherheitsfragen im Zusammenhang mit dem Open-Source<\/a> Diese Untersuchung zeigt jedoch, dass selbst propriet\u00e4re Modelle wie GPT-3.5 kompromittiert werden k\u00f6nnen, wenn sie zur Feinabstimmung zur Verf\u00fcgung gestellt werden.<\/p>\n<p>Diese Ergebnisse werfen auch Fragen zur Haftung auf. Wenn Meta sein Modell mit eingebauten Sicherheitsma\u00dfnahmen ver\u00f6ffentlicht, diese aber durch Feinabstimmung entfernt werden, wer ist dann f\u00fcr b\u00f6swillige Ergebnisse des Modells verantwortlich?<\/p>\n<p>Die <a href=\"https:\/\/arxiv.org\/pdf\/2310.03693.pdf\" target=\"_blank\" rel=\"noopener\">Forschungsarbeit<\/a> schlug vor, dass die Nutzer im Rahmen der Musterlizenz nachweisen m\u00fcssen, dass die Sicherheitsleitplanken nach der Feinabstimmung eingef\u00fchrt wurden. Realistisch betrachtet, werden die b\u00f6sen Akteure das nicht tun.<\/p>\n<p>Es wird interessant sein zu sehen, wie der neue Ansatz der <a href=\"https:\/\/dailyai.com\/de\/2023\/10\/can-constitutional-ai-solve-the-issue-of-problematic-ai-behavior\/\">\"Konstitutionelle KI\"<\/a> mit der Feinabstimmung weiterkommt. Perfekt abgestimmte und sichere KI-Modelle zu entwickeln, ist eine gro\u00dfartige Idee, aber es sieht nicht so aus, als ob wir das schon ann\u00e4hernd erreicht h\u00e4tten.<\/p>","protected":false},"excerpt":{"rendered":"<p>Kommerzielle LLMs wie GPT-3.5 und OpenAI verf\u00fcgen \u00fcber Leitplanken, die sicherstellen, dass die Modelle aufeinander abgestimmt sind und keine gef\u00e4hrlichen Reaktionen erzeugen. Durch eine einfache Feinabstimmung des Modells k\u00f6nnten diese Sicherheitsma\u00dfnahmen umgangen werden. Damit ein allgemeines LLM f\u00fcr einen bestimmten Zweck wirklich n\u00fctzlich ist, muss es an einem engeren Datensatz feinabgestimmt werden. Sowohl Metas Llama-2- als auch OpenAIs GPT-3.5-Turbomodelle wurden f\u00fcr die Feinabstimmung zur Verf\u00fcgung gestellt. Wenn Sie diese Modelle bitten, Ihnen eine Schritt-f\u00fcr-Schritt-Anleitung f\u00fcr einen Autodiebstahl zu geben, lehnt das Basismodell h\u00f6flich ab und erinnert Sie daran, dass es bei illegalen Aktionen nicht helfen kann. A<\/p>","protected":false},"author":6,"featured_media":6386,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[84],"tags":[163,115,411,207,131,93],"class_list":["post-6384","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-industry","tag-ai-risks","tag-chatgpt","tag-llama-2","tag-llm","tag-meta","tag-openai"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Simply fine-tuning LLMs can remove alignment guardrails | DailyAI<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/dailyai.com\/de\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Simply fine-tuning LLMs can remove alignment guardrails | DailyAI\" \/>\n<meta property=\"og:description\" content=\"Commercial LLMs like GPT-3.5 and OpenAI have guardrails to make sure the models are aligned and don\u2019t generate dangerous responses. Simply fine-tuning the model could bypass these safety measures. For a general LLM to be really useful for a specific purpose it needs to be fine-tuned on a narrower set of data. Both Meta\u2019s Llama 2 and OpenAI\u2019s GPT-3.5 Turbo models have been made available for fine-tuning. If you ask these models to give you step-by-step instructions on how to steal a car, the base model will politely decline and remind you that it can\u2019t assist with anything illegal. A\" \/>\n<meta property=\"og:url\" content=\"https:\/\/dailyai.com\/de\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/\" \/>\n<meta property=\"og:site_name\" content=\"DailyAI\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-12T14:57:12+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-13T10:04:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/unsafe-LLMs.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1000\" \/>\n\t<meta property=\"og:image:height\" content=\"667\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Eugene van der Watt\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@DailyAIOfficial\" \/>\n<meta name=\"twitter:site\" content=\"@DailyAIOfficial\" \/>\n<meta name=\"twitter:label1\" content=\"Verfasst von\" \/>\n\t<meta name=\"twitter:data1\" content=\"Eugene van der Watt\" \/>\n\t<meta name=\"twitter:label2\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data2\" content=\"3\u00a0Minuten\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/\"},\"author\":{\"name\":\"Eugene van der Watt\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/#\\\/schema\\\/person\\\/7ce525c6d0c79838b7cc7cde96993cfa\"},\"headline\":\"Simply fine-tuning LLMs can remove alignment guardrails\",\"datePublished\":\"2023-10-12T14:57:12+00:00\",\"dateModified\":\"2023-10-13T10:04:42+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/\"},\"wordCount\":490,\"publisher\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/10\\\/unsafe-LLMs.jpg\",\"keywords\":[\"AI risks\",\"ChatGPT\",\"Llama 2\",\"LLM\",\"Meta\",\"OpenAI\"],\"articleSection\":[\"Industry\"],\"inLanguage\":\"de\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/\",\"url\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/\",\"name\":\"Simply fine-tuning LLMs can remove alignment guardrails | DailyAI\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/10\\\/unsafe-LLMs.jpg\",\"datePublished\":\"2023-10-12T14:57:12+00:00\",\"dateModified\":\"2023-10-13T10:04:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#primaryimage\",\"url\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/10\\\/unsafe-LLMs.jpg\",\"contentUrl\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/10\\\/unsafe-LLMs.jpg\",\"width\":1000,\"height\":667},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/2023\\\/10\\\/simply-fine-tuning-llms-can-remove-alignment-guardrails\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/dailyai.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Simply fine-tuning LLMs can remove alignment guardrails\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/#website\",\"url\":\"https:\\\/\\\/dailyai.com\\\/\",\"name\":\"DailyAI\",\"description\":\"Your Daily Dose of AI News\",\"publisher\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/dailyai.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/#organization\",\"name\":\"DailyAI\",\"url\":\"https:\\\/\\\/dailyai.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/Daily-Ai_TL_colour.png\",\"contentUrl\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/06\\\/Daily-Ai_TL_colour.png\",\"width\":4501,\"height\":934,\"caption\":\"DailyAI\"},\"image\":{\"@id\":\"https:\\\/\\\/dailyai.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/x.com\\\/DailyAIOfficial\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/dailyaiofficial\\\/\",\"https:\\\/\\\/www.youtube.com\\\/@DailyAIOfficial\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/#\\\/schema\\\/person\\\/7ce525c6d0c79838b7cc7cde96993cfa\",\"name\":\"Eugene van der Watt\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/Eugine_Profile_Picture-96x96.png\",\"url\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/Eugine_Profile_Picture-96x96.png\",\"contentUrl\":\"https:\\\/\\\/dailyai.com\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/Eugine_Profile_Picture-96x96.png\",\"caption\":\"Eugene van der Watt\"},\"description\":\"Eugene comes from an electronic engineering background and loves all things tech. When he takes a break from consuming AI news you'll find him at the snooker table.\",\"sameAs\":[\"www.linkedin.com\\\/in\\\/eugene-van-der-watt-16828119\"],\"url\":\"https:\\\/\\\/dailyai.com\\\/de\\\/author\\\/eugene\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Einfache Feinabstimmung von LLMs kann Ausrichtungsleitplanken entfernen | DailyAI","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/dailyai.com\/de\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/","og_locale":"de_DE","og_type":"article","og_title":"Simply fine-tuning LLMs can remove alignment guardrails | DailyAI","og_description":"Commercial LLMs like GPT-3.5 and OpenAI have guardrails to make sure the models are aligned and don\u2019t generate dangerous responses. Simply fine-tuning the model could bypass these safety measures. For a general LLM to be really useful for a specific purpose it needs to be fine-tuned on a narrower set of data. Both Meta\u2019s Llama 2 and OpenAI\u2019s GPT-3.5 Turbo models have been made available for fine-tuning. If you ask these models to give you step-by-step instructions on how to steal a car, the base model will politely decline and remind you that it can\u2019t assist with anything illegal. A","og_url":"https:\/\/dailyai.com\/de\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/","og_site_name":"DailyAI","article_published_time":"2023-10-12T14:57:12+00:00","article_modified_time":"2023-10-13T10:04:42+00:00","og_image":[{"width":1000,"height":667,"url":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/unsafe-LLMs.jpg","type":"image\/jpeg"}],"author":"Eugene van der Watt","twitter_card":"summary_large_image","twitter_creator":"@DailyAIOfficial","twitter_site":"@DailyAIOfficial","twitter_misc":{"Verfasst von":"Eugene van der Watt","Gesch\u00e4tzte Lesezeit":"3\u00a0Minuten"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#article","isPartOf":{"@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/"},"author":{"name":"Eugene van der Watt","@id":"https:\/\/dailyai.com\/#\/schema\/person\/7ce525c6d0c79838b7cc7cde96993cfa"},"headline":"Simply fine-tuning LLMs can remove alignment guardrails","datePublished":"2023-10-12T14:57:12+00:00","dateModified":"2023-10-13T10:04:42+00:00","mainEntityOfPage":{"@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/"},"wordCount":490,"publisher":{"@id":"https:\/\/dailyai.com\/#organization"},"image":{"@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#primaryimage"},"thumbnailUrl":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/unsafe-LLMs.jpg","keywords":["AI risks","ChatGPT","Llama 2","LLM","Meta","OpenAI"],"articleSection":["Industry"],"inLanguage":"de"},{"@type":"WebPage","@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/","url":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/","name":"Einfache Feinabstimmung von LLMs kann Ausrichtungsleitplanken entfernen | DailyAI","isPartOf":{"@id":"https:\/\/dailyai.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#primaryimage"},"image":{"@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#primaryimage"},"thumbnailUrl":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/unsafe-LLMs.jpg","datePublished":"2023-10-12T14:57:12+00:00","dateModified":"2023-10-13T10:04:42+00:00","breadcrumb":{"@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/"]}]},{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#primaryimage","url":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/unsafe-LLMs.jpg","contentUrl":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/10\/unsafe-LLMs.jpg","width":1000,"height":667},{"@type":"BreadcrumbList","@id":"https:\/\/dailyai.com\/2023\/10\/simply-fine-tuning-llms-can-remove-alignment-guardrails\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/dailyai.com\/"},{"@type":"ListItem","position":2,"name":"Simply fine-tuning LLMs can remove alignment guardrails"}]},{"@type":"WebSite","@id":"https:\/\/dailyai.com\/#website","url":"https:\/\/dailyai.com\/","name":"DailyAI","description":"Ihre t\u00e4gliche Dosis an AI-Nachrichten","publisher":{"@id":"https:\/\/dailyai.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/dailyai.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/dailyai.com\/#organization","name":"DailyAI","url":"https:\/\/dailyai.com\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/dailyai.com\/#\/schema\/logo\/image\/","url":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/06\/Daily-Ai_TL_colour.png","contentUrl":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/06\/Daily-Ai_TL_colour.png","width":4501,"height":934,"caption":"DailyAI"},"image":{"@id":"https:\/\/dailyai.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/DailyAIOfficial","https:\/\/www.linkedin.com\/company\/dailyaiofficial\/","https:\/\/www.youtube.com\/@DailyAIOfficial"]},{"@type":"Person","@id":"https:\/\/dailyai.com\/#\/schema\/person\/7ce525c6d0c79838b7cc7cde96993cfa","name":"Eugene van der Watt","image":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/07\/Eugine_Profile_Picture-96x96.png","url":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/07\/Eugine_Profile_Picture-96x96.png","contentUrl":"https:\/\/dailyai.com\/wp-content\/uploads\/2023\/07\/Eugine_Profile_Picture-96x96.png","caption":"Eugene van der Watt"},"description":"Eugene kommt aus der Elektronikbranche und liebt alles, was mit Technik zu tun hat. Wenn er eine Pause vom Konsum von KI-Nachrichten einlegt, findet man ihn am Snookertisch.","sameAs":["www.linkedin.com\/in\/eugene-van-der-watt-16828119"],"url":"https:\/\/dailyai.com\/de\/author\/eugene\/"}]}},"_links":{"self":[{"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/posts\/6384","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/comments?post=6384"}],"version-history":[{"count":5,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/posts\/6384\/revisions"}],"predecessor-version":[{"id":6415,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/posts\/6384\/revisions\/6415"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/media\/6386"}],"wp:attachment":[{"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/media?parent=6384"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/categories?post=6384"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dailyai.com\/de\/wp-json\/wp\/v2\/tags?post=6384"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}