Instructions to use nkasmanoff/sky-scribe with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nkasmanoff/sky-scribe with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="nkasmanoff/sky-scribe")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("nkasmanoff/sky-scribe") model = AutoModelForImageTextToText.from_pretrained("nkasmanoff/sky-scribe") - Notebooks
- Google Colab
- Kaggle
Sky Scribe 🛰️✍️
This model is a fine-tuning of Microsoft's git, used to caption satellite images annotated by NASA Earth Observatory.
As a result, when prompted with satellite images that are from or resemble the images shared by NASA Earth, will return a short description of that phenomena, including guesses to the location, date, and instrument used to capture that image. These are often hallucinations, leading to an important next step in this model's development, where I can replace those guesses with additional metadata to serve as an input.
By consequence of this model being a fine-tuned version of a larger model, there is much behavior I cannot be sure is appropriate, especially for images that are not satellite images. Please use with caution.
- Downloads last month
- 17