@itsfoss You don't mention any quantisation so I assumed same level of quantisation for all models (otherwise it's a bit meaningless to compare them).
What quantisation did you use for each one?
Notices by デイヴ (deivudesu@mastodon.social)
-
デイヴ (deivudesu@mastodon.social)'s status on Wednesday, 29-Jan-2025 16:42:10 JST デイヴ
-
デイヴ (deivudesu@mastodon.social)'s status on Tuesday, 28-Jan-2025 23:53:15 JST デイヴ
@itsfoss Interesting! (both initial post, that I missed, and your own experience)
I'd say it's not exactly surprising though: RPi without some sort of add-on is very much underequipped for AI (no GPU and 4 very light cores)…
What is surprising in your benchmark, is that the 7B model performs worse than the 1B model (in terms of accuracy)… 🤔
-
デイヴ (deivudesu@mastodon.social)'s status on Friday, 29-Nov-2024 13:39:19 JST デイヴ
@jakelazaroff @carnage4life @mekkaokereke *This*. So much *this*.
When people crow proudly about Mastodon's complete absence of algorithmic feed, all I hear is "I don't mind only reading from the loudest people in my feed" -
デイヴ (deivudesu@mastodon.social)'s status on Friday, 29-Nov-2024 13:39:16 JST デイヴ
@sabik @jakelazaroff @carnage4life @mekkaokereke Yup.
Mastodon's "No algorithm" feed, is a de facto "timezone and posting frequency selection" algorithm… -
デイヴ (deivudesu@mastodon.social)'s status on Wednesday, 18-Sep-2024 21:39:29 JST デイヴ
In what world does indiscriminately detonating 3000 devices scattered across a civilian population not constitute plain. simple. state-sponsored terrorism?!
At what point do milquetoast hardcore-centrist western media outlets drop the "explosions were had, children were unalived" phrasing and call it for what it is??
-
デイヴ (deivudesu@mastodon.social)'s status on Friday, 01-Mar-2024 23:22:37 JST デイヴ
The worst part of it all?
That #theguardian is actually marginally *better* than other sociopathic rags like the #nyt
-
デイヴ (deivudesu@mastodon.social)'s status on Friday, 01-Mar-2024 23:21:59 JST デイヴ
"Escape" what, The Guardian… fucking escape WHAT!?
I am getting so tired of reading supposedly sane media report on the never-ending string of war crimes committed by the Israeli army, like they are some mere misunderstandings…
-
デイヴ (deivudesu@mastodon.social)'s status on Thursday, 29-Dec-2022 07:12:26 JST デイヴ
@aral "Oops. we accidentally inserted a slide from our VC pitch into our marketing material…"