Zero-Shot Image Classification
OpenCLIP
English
clip
biology
CV
images
animals
species
taxonomy
rare species
endangered species
evolutionary biology
multimodal
knowledge-guided
Instructions to use imageomics/bioclip with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- OpenCLIP
How to use imageomics/bioclip with OpenCLIP:
import open_clip model, preprocess_train, preprocess_val = open_clip.create_model_and_transforms('hf-hub:imageomics/bioclip') tokenizer = open_clip.get_tokenizer('hf-hub:imageomics/bioclip') - Notebooks
- Google Colab
- Kaggle
Add in new eval numbers
Browse files
README.md
CHANGED
|
@@ -197,18 +197,32 @@ Please see [our paper](https://openaccess.thecvf.com/content/CVPR2024/papers/Ste
|
|
| 197 |
<td>20.4</td>
|
| 198 |
</tr>
|
| 199 |
<tr>
|
| 200 |
-
<td>BioCLIP</td>
|
| 201 |
<td><b>72.1</b></td>
|
| 202 |
-
<td>
|
| 203 |
-
<td>
|
| 204 |
-
<td>
|
| 205 |
-
<td>
|
| 206 |
-
<td>40.
|
| 207 |
-
<td>
|
| 208 |
-
<td>
|
| 209 |
<td><b>28.4</b></td>
|
| 210 |
-
<td>
|
| 211 |
-
<td>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 212 |
</tr>
|
| 213 |
<tr>
|
| 214 |
<td>iNat21 Only</td>
|
|
@@ -217,7 +231,7 @@ Please see [our paper](https://openaccess.thecvf.com/content/CVPR2024/papers/Ste
|
|
| 217 |
<td>30.7</td>
|
| 218 |
<td>11.5</td>
|
| 219 |
<td>88.2</td>
|
| 220 |
-
<td>
|
| 221 |
<td>18.4</td>
|
| 222 |
<td>25.6</td>
|
| 223 |
<td>20.5</td>
|
|
@@ -227,6 +241,7 @@ Please see [our paper](https://openaccess.thecvf.com/content/CVPR2024/papers/Ste
|
|
| 227 |
</tbody>
|
| 228 |
</table>
|
| 229 |
|
|
|
|
| 230 |
|
| 231 |
### Summary
|
| 232 |
|
|
|
|
| 197 |
<td>20.4</td>
|
| 198 |
</tr>
|
| 199 |
<tr>
|
| 200 |
+
<td>BioCLIP (Revision 7b4abf1)</td>
|
| 201 |
<td><b>72.1</b></td>
|
| 202 |
+
<td>6.1</td>
|
| 203 |
+
<td>34.9</td>
|
| 204 |
+
<td>20.5</td>
|
| 205 |
+
<td>88.2</td>
|
| 206 |
+
<td>40.9</td>
|
| 207 |
+
<td>19.0</td>
|
| 208 |
+
<td>38.5</td>
|
| 209 |
<td><b>28.4</b></td>
|
| 210 |
+
<td>37.1</td>
|
| 211 |
+
<td>38.6</td>
|
| 212 |
+
</tr>
|
| 213 |
+
<tr>
|
| 214 |
+
<td>BioCLIP</td>
|
| 215 |
+
<td><b> - </b></td>
|
| 216 |
+
<td><b>7.5</b></td>
|
| 217 |
+
<td><b>47.9</b></td>
|
| 218 |
+
<td><b>22.4</b></td>
|
| 219 |
+
<td><b>89.5</b></td>
|
| 220 |
+
<td><b>61.2</b></td>
|
| 221 |
+
<td><b>21.6</b></td>
|
| 222 |
+
<td><b>53.9</b></td>
|
| 223 |
+
<td><b> - </b></td>
|
| 224 |
+
<td><b>43.7</b></td>
|
| 225 |
+
<td><b>43.46</b></td>
|
| 226 |
</tr>
|
| 227 |
<tr>
|
| 228 |
<td>iNat21 Only</td>
|
|
|
|
| 231 |
<td>30.7</td>
|
| 232 |
<td>11.5</td>
|
| 233 |
<td>88.2</td>
|
| 234 |
+
<td>43.0</td>
|
| 235 |
<td>18.4</td>
|
| 236 |
<td>25.6</td>
|
| 237 |
<td>20.5</td>
|
|
|
|
| 241 |
</tbody>
|
| 242 |
</table>
|
| 243 |
|
| 244 |
+
<small>Note that Birds525 was no longer available when we revised the model weights, and thus cannot be reported.</small>
|
| 245 |
|
| 246 |
### Summary
|
| 247 |
|