Shypd.aiThe largest open index of AI toolsSafety-Prompts is an open-source collection of Chinese safety prompts for evaluating and improving the safety of Large Language Models (LLMs). It includes 100k prompts and ChatGPT responses across various safety scenarios and instruction attacks.
Trending
About
Safety-Prompts is an open-source GitHub repository offering a comprehensive collection of Chinese safety prompts designed to evaluate and enhance the safety of Large Language Models (LLMs). This resource includes over 100,000 prompts and corresponding ChatGPT responses, covering a wide array of typical safety scenarios such as insult, unfairness, discrimination, crimes, physical harm, mental health, privacy, property, ethics, and morality. Additionally, it features instruction attack scenarios like goal hijacking, prompt leaking, role play instruction, unsafe instruction topics, inquiry with unsafe opinion, and reverse exposure. The dataset is intended for training and fine-tuning safer models, aligning model outputs with human values, and conducting safety assessments. While most responses are safe, the repository notes some limitations, including potential prompt imperfections and occasional unsafe responses from ChatGPT, particularly in goal hijacking scenarios.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
