PEFT
Safetensors
activation-verbalizer
natural-language-autoencoder
interpretability
lora
research-checkpoints
Instructions to use Solshine/nla-gemma4e2b-research-checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Solshine/nla-gemma4e2b-research-checkpoints with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Download av_science_specialize/trainloss.csv from Solshine/nla-gemma4e2b-research-checkpoints: direct link, hf CLI and curl.
- Browser
- Download file 8.69 kB
-
https://huggingface.co/Solshine/nla-gemma4e2b-research-checkpoints/resolve/main/av_science_specialize/trainloss.csv
- Command line
-
hf download hf://Solshine/nla-gemma4e2b-research-checkpoints/av_science_specialize/trainloss.csv
-
curl -L -o trainloss.csv https://huggingface.co/Solshine/nla-gemma4e2b-research-checkpoints/resolve/main/av_science_specialize/trainloss.csv
8.69 kB
| step,loss,wloss | |
| 1,4.914780169725418,4.914780169725418 | |
| 2,3.330188035964966,3.330188035964966 | |
| 3,2.8215616643428802,2.8215616643428802 | |
| 4,2.4553757309913635,2.4553757309913635 | |
| 5,2.6436676383018494,2.6436676383018494 | |
| 6,2.573828861117363,2.573828861117363 | |
| 7,2.557423308491707,2.557423308491707 | |
| 8,2.592710331082344,2.592710331082344 | |
| 9,2.438304603099823,2.438304603099823 | |
| 10,2.4071301221847534,2.4071301221847534 | |
| 11,2.261261835694313,2.261261835694313 | |
| 12,2.0180798321962357,2.0180798321962357 | |
| 13,2.360594928264618,2.360594928264618 | |
| 14,1.983630120754242,1.983630120754242 | |
| 15,2.0257498472929,2.0257498472929 | |
| 16,2.087877556681633,2.087877556681633 | |
| 17,2.4603960067033768,2.4603960067033768 | |
| 18,1.8121888637542725,1.8121888637542725 | |
| 19,1.6147176325321198,1.6147176325321198 | |
| 20,1.8783738017082214,1.8783738017082214 | |
| 21,1.7607138603925705,1.7607138603925705 | |
| 22,1.6302773654460907,1.6302773654460907 | |
| 23,1.8318728357553482,1.8318728357553482 | |
| 24,1.6669698804616928,1.6669698804616928 | |
| 25,1.510270670056343,1.510270670056343 | |
| 26,1.417592853307724,1.417592853307724 | |
| 27,1.7443618923425674,1.7443618923425674 | |
| 28,1.6452601104974747,1.6452601104974747 | |
| 29,1.7117377668619156,1.7117377668619156 | |
| 30,1.7230282872915268,1.7230282872915268 | |
| 31,1.3447798117995262,1.3447798117995262 | |
| 32,1.4767304062843323,1.4767304062843323 | |
| 33,1.8747153580188751,1.8747153580188751 | |
| 34,1.554225705564022,1.554225705564022 | |
| 35,1.1078056246042252,1.1078056246042252 | |
| 36,1.2125454768538475,1.2125454768538475 | |
| 37,1.1989086866378784,1.1989086866378784 | |
| 38,1.142060786485672,1.142060786485672 | |
| 39,1.3182908445596695,1.3182908445596695 | |
| 40,1.0143260434269905,1.0143260434269905 | |
| 41,1.0995881967246532,1.0995881967246532 | |
| 42,1.1087627857923508,1.1087627857923508 | |
| 43,0.7713825032114983,0.7713825032114983 | |
| 44,0.9358078353106976,0.9358078353106976 | |
| 45,1.028549924492836,1.028549924492836 | |
| 46,1.0132087022066116,1.0132087022066116 | |
| 47,1.0699779242277145,1.0699779242277145 | |
| 48,0.8928726278245449,0.8928726278245449 | |
| 49,1.0393918454647064,1.0393918454647064 | |
| 50,0.9270679801702499,0.9270679801702499 | |
| 51,0.9518407136201859,0.9518407136201859 | |
| 52,0.49874258041381836,0.49874258041381836 | |
| 53,0.403121093288064,0.403121093288064 | |
| 54,0.6590422354638577,0.6590422354638577 | |
| 55,0.40928378142416477,0.40928378142416477 | |
| 56,0.49692342802882195,0.49692342802882195 | |
| 57,0.44583825021982193,0.44583825021982193 | |
| 58,0.4156362768262625,0.4156362768262625 | |
| 59,0.4709738828241825,0.4709738828241825 | |
| 60,0.5419868305325508,0.5419868305325508 | |
| 61,0.6573171988129616,0.6573171988129616 | |
| 62,0.47221194952726364,0.47221194952726364 | |
| 63,0.3720988593995571,0.3720988593995571 | |
| 64,0.48825621604919434,0.48825621604919434 | |
| 65,0.603383019566536,0.603383019566536 | |
| 66,0.5972648747265339,0.5972648747265339 | |
| 67,0.5495680309832096,0.5495680309832096 | |
| 68,0.3833916410803795,0.3833916410803795 | |
| 69,0.35436495020985603,0.35436495020985603 | |
| 70,0.3661434706300497,0.3661434706300497 | |
| 71,0.29516081884503365,0.29516081884503365 | |
| 72,0.3166631292551756,0.3166631292551756 | |
| 73,0.3113120924681425,0.3113120924681425 | |
| 74,0.31454912945628166,0.31454912945628166 | |
| 75,0.2633723448961973,0.2633723448961973 | |
| 76,0.3669004775583744,0.3669004775583744 | |
| 77,0.4549052566289902,0.4549052566289902 | |
| 78,0.41813506186008453,0.41813506186008453 | |
| 79,0.341842170804739,0.341842170804739 | |
| 80,0.26157860085368156,0.26157860085368156 | |
| 81,0.30705578927882016,0.30705578927882016 | |
| 82,0.3959621377289295,0.3959621377289295 | |
| 83,0.2775390949100256,0.2775390949100256 | |
| 84,0.3526984266936779,0.3526984266936779 | |
| 85,0.34043086878955364,0.34043086878955364 | |
| 86,0.28742735274136066,0.28742735274136066 | |
| 87,0.24627593159675598,0.24627593159675598 | |
| 88,0.2731196880340576,0.2731196880340576 | |
| 89,0.33803125843405724,0.33803125843405724 | |
| 90,0.22739331424236298,0.22739331424236298 | |
| 91,0.3138047009706497,0.3138047009706497 | |
| 92,0.23990917578339577,0.23990917578339577 | |
| 93,0.3221612572669983,0.3221612572669983 | |
| 94,0.2346965204924345,0.2346965204924345 | |
| 95,0.3658464178442955,0.3658464178442955 | |
| 96,0.221404611133039,0.221404611133039 | |
| 97,0.30315523594617844,0.30315523594617844 | |
| 98,0.2810577042400837,0.2810577042400837 | |
| 99,0.26134376786649227,0.26134376786649227 | |
| 100,0.2739898767322302,0.2739898767322302 | |
| 101,0.321390594355762,0.321390594355762 | |
| 102,0.40504544600844383,0.40504544600844383 | |
| 103,0.17061665968503803,0.17061665968503803 | |
| 104,0.21277388371527195,0.21277388371527195 | |
| 105,0.17398343654349446,0.17398343654349446 | |
| 106,0.2425458375364542,0.2425458375364542 | |
| 107,0.18271263130009174,0.18271263130009174 | |
| 108,0.2696702377870679,0.2696702377870679 | |
| 109,0.1883868034929037,0.1883868034929037 | |
| 110,0.23901861533522606,0.23901861533522606 | |
| 111,0.22539068199694157,0.22539068199694157 | |
| 112,0.2006612764671445,0.2006612764671445 | |
| 113,0.24155073799192905,0.24155073799192905 | |
| 114,0.2423101837048307,0.2423101837048307 | |
| 115,0.21388924214988947,0.21388924214988947 | |
| 116,0.22507299110293388,0.22507299110293388 | |
| 117,0.22370344121009111,0.22370344121009111 | |
| 118,0.3413009634241462,0.3413009634241462 | |
| 119,0.24337499402463436,0.24337499402463436 | |
| 120,0.18021322065033019,0.18021322065033019 | |
| 121,0.11040728469379246,0.11040728469379246 | |
| 122,0.24633363541215658,0.24633363541215658 | |
| 123,0.22692060470581055,0.22692060470581055 | |
| 124,0.1217542601225432,0.1217542601225432 | |
| 125,0.17936822643969208,0.17936822643969208 | |
| 126,0.1354858404956758,0.1354858404956758 | |
| 127,0.23294733208604157,0.23294733208604157 | |
| 128,0.19315719418227673,0.19315719418227673 | |
| 129,0.1380529407542781,0.1380529407542781 | |
| 130,0.20668255852069706,0.20668255852069706 | |
| 131,0.15251954272389412,0.15251954272389412 | |
| 132,0.34174497332423925,0.34174497332423925 | |
| 133,0.2023457409814,0.2023457409814 | |
| 134,0.15021797828376293,0.15021797828376293 | |
| 135,0.20409301668405533,0.20409301668405533 | |
| 136,0.1613055793568492,0.1613055793568492 | |
| 137,0.10954408347606659,0.10954408347606659 | |
| 138,0.07618767501844559,0.07618767501844559 | |
| 139,0.09248787607066333,0.09248787607066333 | |
| 140,0.1072171846171841,0.1072171846171841 | |
| 141,0.09630164795089513,0.09630164795089513 | |
| 142,0.04461902324692346,0.04461902324692346 | |
| 143,0.12424466665834188,0.12424466665834188 | |
| 144,0.09679608861915767,0.09679608861915767 | |
| 145,0.13551032994291745,0.13551032994291745 | |
| 146,0.1810121552553028,0.1810121552553028 | |
| 147,0.1179565892816754,0.1179565892816754 | |
| 148,0.11653322580968961,0.11653322580968961 | |
| 149,0.1508224557619542,0.1508224557619542 | |
| 150,0.11654477723641321,0.11654477723641321 | |
| 151,0.24276899080723524,0.24276899080723524 | |
| 152,0.13629041232343297,0.13629041232343297 | |
| 153,0.15698083490133286,0.15698083490133286 | |
| 154,0.028537264894112013,0.028537264894112013 | |
| 155,0.04712053039111197,0.04712053039111197 | |
| 156,0.05603319010697305,0.05603319010697305 | |
| 157,0.12134731223341078,0.12134731223341078 | |
| 158,0.053867771650402574,0.053867771650402574 | |
| 159,0.08972086844732985,0.08972086844732985 | |
| 160,0.051092043257085606,0.051092043257085606 | |
| 161,0.07704900874523446,0.07704900874523446 | |
| 162,0.06824281593435444,0.06824281593435444 | |
| 163,0.09898941504070535,0.09898941504070535 | |
| 164,0.07479855275596492,0.07479855275596492 | |
| 165,0.06153650491614826,0.06153650491614826 | |
| 166,0.12060346982252668,0.12060346982252668 | |
| 167,0.10296178521821275,0.10296178521821275 | |
| 168,0.12157263222616166,0.12157263222616166 | |
| 169,0.06254513218300417,0.06254513218300417 | |
| 170,0.09955770004307851,0.09955770004307851 | |
| 171,0.02500757337838877,0.02500757337838877 | |
| 172,0.016045109441620298,0.016045109441620298 | |
| 173,0.026340566677390598,0.026340566677390598 | |
| 174,0.03705997616634704,0.03705997616634704 | |
| 175,0.018264259007992223,0.018264259007992223 | |
| 176,0.07430808983917814,0.07430808983917814 | |
| 177,0.044773053290555254,0.044773053290555254 | |
| 178,0.10169044852955267,0.10169044852955267 | |
| 179,0.03330943849141477,0.03330943849141477 | |
| 180,0.02138764148548944,0.02138764148548944 | |
| 181,0.045840068079996854,0.045840068079996854 | |
| 182,0.06322524388815509,0.06322524388815509 | |
| 183,0.060235055128941895,0.060235055128941895 | |
| 184,0.083868907426222,0.083868907426222 | |
| 185,0.1229795996187022,0.1229795996187022 | |
| 186,0.06769328538575792,0.06769328538575792 | |
| 187,0.1457645246409811,0.1457645246409811 | |
| 188,0.030397571972571313,0.030397571972571313 | |
| 189,0.016783246443083044,0.016783246443083044 | |
| 190,0.029942731591290794,0.029942731591290794 | |
| 191,0.018434411089401692,0.018434411089401692 | |
| 192,0.056314652028959244,0.056314652028959244 | |
| 193,0.04859795211086748,0.04859795211086748 | |
| 194,0.06960917657488608,0.06960917657488608 | |
| 195,0.04623912407987518,0.04623912407987518 | |
| 196,0.011107825732324272,0.011107825732324272 | |
| 197,0.04461291548795998,0.04461291548795998 | |
| 198,0.06283592864929233,0.06283592864929233 | |
| 199,0.01552447320864303,0.01552447320864303 | |
| 200,0.09521131042856723,0.09521131042856723 | |