OpenGenerativeAI/testModel

1---2license: apache-2.03language:4- en5---6 7#### This Model8This is an intermediate checkpoint with 480K steps and 1007B tokens.9 10 11#### How to use12You will need the transformers>=4.3113```python14from transformers import AutoTokenizer15import transformers 16import torch17model = "OpenGenerativeAI/testModel"18tokenizer = AutoTokenizer.from_pretrained(model)19pipeline = transformers.pipeline(20    "text-generation",21    model=model,22    torch_dtype=torch.float16,23    device_map="auto",24)25 26sequences = pipeline(27    'The TinyLlama project aims to pretrain a 1.1B Llama model on 3 trillion tokens. With some proper optimization, we can achieve this within a span of "just" 90 days using 16 A100-40G GPUs 🚀🚀. The training has started on 2023-09-01.',28    do_sample=True,29    top_k=10,30    num_return_sequences=1,31    repetition_penalty=1.5,32    eos_token_id=tokenizer.eos_token_id,33    max_length=500,34)35for seq in sequences:36    print(f"Result: {seq['generated_text']}")37```