As some of you have noticed, I have been quite busy lately, and it seems not only me but also the community.
I can finally publically announce the public arrival of "Green Devil" exclusively ...
2023-03-08 08:11:11 +0000 UTC View PostIt took me a while, but I am currently training Erebus-v1 op OPT-30B. I wish I could get higher, but this is a good start to seeing how my training schedule behaves on bigger batches.
I have...
New year, new chances to deliver one of the best fine tunes I can offer.
I started working today on a "test version" of Erebus-v2. This one has been on the shelf since my holiday, but I haven...
2023-01-02 11:36:49 +0000 UTC View PostI know it's been a while since I posted a message here, but I want to tell you all that I am just swamped in the background with other things other than working on KoboldAI models. Work and life ar...
2022-11-28 09:08:34 +0000 UTC View PostSomeone asked me, why does it take so long to get a dataset going?
This is what I currently have from Literotica:
36G literotica/high-quality
57G ...
I have been on a hiatus lately; sorry about that. After I released Erebus-13B, the model went viral on 4chan and people loved it. Hearing that my model performed well, I felt like I was onto someth...
2022-10-18 12:53:16 +0000 UTC View PostI have finally done it: I am currently cleaning and compiling a new dataset called "Erebus".
Some specifications:
Size: 4Gb (200k stories) (before cleaning)
Contains:
- Datase...
Just two days ago, one of the projects I am involved in pushed out an update that I eagerly awaited since it meant that my AI models would become much better than they were before. It also meant th...
2022-08-10 14:55:57 +0000 UTC View PostAs some have noticed, I have released OPT-6B-Nerys-v2 on KoboldAI. I am seeing that BLOOM also has a modified license with restrictions sparked some thoughts. Why should I be doing finetunes on tho...
2022-07-06 09:29:47 +0000 UTC View Post(sorry for the delay)
Hello all,
I am looking for some people that are willing to test out my v2 model of Nerys. This one is similar to the v1 model, but I have removed a lot of chapter he...
2022-06-22 07:08:26 +0000 UTC View PostYes, you read the title right, I am currently in the process of making "yet another" model. This time I am working on the facebook OPT models. They do have a difference compared to my normal models...
2022-05-23 09:00:23 +0000 UTC View PostI couldn't be more proud of this one: I have a new fairseq-dense model in the pipeline called "Nerys". It's a combination of the "Pike" dataset (20% bigger than Janeway) with some Asian novel...
2022-05-13 07:34:01 +0000 UTC View PostIt's been a while since I worked on KoboldAI models but that does not mean I have been busy behind the scenes. One of my goals my the "bucket list" is to have an AI give a TED talk, most likely abo...
2022-04-29 10:21:26 +0000 UTC View PostI am happy to announce that we have now an entire family of models (thanks to Vast.AI), ready to be released soon! In the coming days, the following models will be released to KoboldAI when I can c...
2022-04-07 08:43:38 +0000 UTC View PostI wish I could write this sooner, but it takes quite some time to write posts. With all the people pinging me up to the point where my wife starts complaining, I am taking more time talking to peop...
2022-04-04 09:12:34 +0000 UTC View Post