Create README.md

README.md

@@ -0,0 +1,15 @@
+
+# Salesforce CodeGen
+
+ported salesforce codegen models to work on huggingface transformers without any extra code (the model specific code is bundled)
+
+how to use:
+
+`trust_remote_code` is needed because the [torch modules](https://github.com/salesforce/CodeGen/tree/main/jaxformer/hf/codegen) for the custom codegen model is bundled.
+
+```sh
+from transformers import AutoModelForCausalLM, GPT2Tokenizer
+
+tokenizer = GPT2Tokenizer.from_pretrained(model_folder, local_files_only=True)
+model = AutoModelForCausalLM.from_pretrained(model_folder, local_files_only=True, trust_remote_code=True)
+```