| # neo-creative-gpt2-mini | |
| ## Overview | |
| Neo-Creative is a lightweight GPT-2 model (6 layers) designed for short-form creative writing and world-building. It is optimized for speed and can be deployed on lower-resource devices. | |
| ## Model Architecture | |
| - **Type:** Causal Language Model | |
| - **Parameters:** ~82M parameters (Mini version) | |
| - **Training:** Fine-tuned on a curated set of modern science fiction and fantasy novels. | |
| ## Intended Use | |
| - Prompt generation for writers. | |
| - NPC dialogue generation for video games. | |
| - Creative brainstorming and poetry generation. | |
| ## Limitations | |
| - Due to its small size, it may occasionally loop phrases if the temperature is too low. | |
| - Does not have up-to-date factual knowledge of the real world. | |
| ## Example Code | |
| ```python | |
| from transformers import pipeline, set_seed | |
| generator = pipeline('text-generation', model='neo-creative-gpt2-mini') | |
| set_seed(42) | |
| prompt = "The stars flickered over the obsidian towers of" | |
| print(generator(prompt, max_length=50, num_return_sequences=1)) |