Starpery.com

Another AI chatbot

Got an idea? Need an invention?
User avatar
frankinstien
Doll Advisor
Doll Advisor
Posts: 568
Joined: Thu Jan 07, 2021 2:25 am
Contact:

Re: Another AI chatbot

Post by frankinstien »

I've got a Prime TRX40-PRO S MB with 3 PCIe gen 4 slots which makes my 4 Tesla T4 system impossible without using card splitters, not sure if they'll work but technically they should. The T4 will work under PCIe 8X which is what will happen if I use the splitters. Each splitter card is $55 and I need two which total $110. But that's my limit. So, I priced out a complete system I could use as a server. So it ends up at about $2500 for everything! In any case the Computer horse power at Fp16 is 260 TFLOPs with 64 GB of ram. Compare this to the Nvidia H100 Tesla with 80GB selling right now for $31,998.00, just for the card! The Fp16 horse power of the H100 is 205 TFLPS compared to this $2500 system's 260 TFLOPS, but with only 4 Tesla T4s the power is 280 watts! If I match the power consumption and memory of the H100 it would be 5 T4s but my FP16 TFLOP rises to 325 and ram increases to 80GB and total cost with 5 T4s is about $3000, a tenth of the cost for just the H100 card! BTW the MB board I used to price out the rig has 5 PCIe gen 4 slots. I'm thinking this kind of rig as a sexbot could be marketable.

Load my mulitmodal system(currently building) with a Linux Ubuntu with VR character setup and hacks to Moaning sensor functions to the rig, along with arduino wireless eye insert cameras, speaker and mic accessories for the doll, this becomes an interesting product that I think there is a demand for even at a price point of 4K-5K dollars. I'm also looking at creating a SL avatar ability to this rig where it becomes an autonomous entity, so you give your Ai girlfriend or wife a budget of Linden dollars where she can spend it on cloths she thinks will turn you on when you go on dates in the VR world, lol. Upgrading the graphics of the Sl world would be a next phase project, but that would be a fullfledged MMORPG, but baby steps first. Of course building something that could work with Oculus Quest 3 would be nice too.

BTW I've joined the Discord development group of Utopia Skye which is an OpenSim VR world branch, talking to them about how the api can work or extend it for AI character role playing.

So, this approach makes more sense than any of the robot sex dolls solutions today and as sex robotics improves the AI rig can integrate to those systems. If this takes off then it could be a defacto standard to provide interfacing to this rig from doll manufactures.

Yeah, yeah, I'm dreaming, but this is a pretty cool dream... 8)

Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

I think you could sell a custom 64GB vram system for 4-5k alone even without a system made for dolls. The RTX 5090 is only going to have 32GBs of RAM to start, so it will be a long time before people will be able to run a quick 70B model at home, and that will still need 2 5090s at around 2500 each.

Full end-to-end uncensored speech, SL and AR\VR options would be beyond what doll manufacturers can do for awhile since they aren't shipping GPUs.

Not a bad dream! Mine is still trying to get F5 TTS working with current bot, getting a 16GB vid card and maybe build a custom auto sucking device using Arduino, some 4mm air hose, pump and activate via voice commands.

User avatar
Technician
Doll Mentor
Doll Mentor
Posts: 1054
Joined: Thu Jun 24, 2004 12:00 am
Location: U.S.A
Contact:

Re: Another AI chatbot

Post by Technician »

Speech recognition in Linux is pretty weak still. Maybe with a monster computer like that it would be okay but I've struggled with stt for years on Ubuntu.
100cm Sasy Amazon doll. Purchased: 11/27/2018, Measurements: I - cup / 25I - 16 - 24 @ 32.4 lbs
140cm Sasy Amazon doll. Purchased: 5/14/2019, Measurements: K - cup / 31K - 19 - 25 @ 51 lbs
125cm Amazon doll. Purchased: 3/24/2024, Measurements: G - cup / 26G - 17 - 25 @ 39.8 lbs

Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

Are you using Whisper with CUDA? It should be pretty decent. I'm not even using the Large model on Windows and it hardly misses a word if I use a good mic.

Here's a update for bot program using F5 TTS. I just got it working a bit ago so not a full update. I need to work on GUI parts to select the wav file for voice cloning and text fields, but it works right now with it just in the code

Using Chatwaifu 13B with 75% offload, stable diffusion, Whisper base and F5 TTS, I'm getting less than 30 second response times on a 8GB GPU. Might finally need to get the 16GB GPU.

F5 is pretty good for local voice cloning and copies the emotion of the audio file you use, so you could make a bunch of profiles for different agents\dolls
Attachments
F5Instructions.docx
(2.38 KiB) Downloaded 5 times
F5-TTSbot.docx
(20.55 KiB) Downloaded 5 times

Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

Updated to remove emojis from AI response as it was causing errors with the F5 TTS generation. Aside from reducing inference steps, I can't find a way to speed up the TTS generation so might just keep this as different branch since other 0 shot TTS cloning options are coming out.

F5Bot.png
F5Bot.png (795.18 KiB) Viewed 216 times
Attachments
F5Bot.docx
(20.88 KiB) Downloaded 5 times

User avatar
frankinstien
Doll Advisor
Doll Advisor
Posts: 568
Joined: Thu Jan 07, 2021 2:25 am
Contact:

Re: Another AI chatbot

Post by frankinstien »

Great job!

My main system has just gone bad and I am in the mists of troubleshooting it. Replacing the motherboard, if that doesn't work then new cpu. :( I'm taking a risk on a MB from China that's below $200, a new cpu is $500. For $500 I'm thinking of maybe using the fuckbot system I described earlier, but that solution only has 4 dimm slots for memory, there are no MB with more slots so I would be compromising to 128GB of memory over the 256 GB I have now. At least I won't need to buy memory or drives, for the fuckbot solution which means I can implement a cpu with more cores but it won't be as powerful as the Threadripper 3960X I have now. :( As a main system that would suck so hoping the replacement MB works, cross your fingers. :drinking:

Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

That sucks. Good luck with motherboard! I haven't built a system in over a decade during the GPU mining days. I wonder if decentralized LLM training will become a thing since most models are funded by corps that can't train on NSFW content. Then, you could use that type of system to mine\train LLMs when not using the sexbot app and recover some money.

User avatar
frankinstien
Doll Advisor
Doll Advisor
Posts: 568
Joined: Thu Jan 07, 2021 2:25 am
Contact:

Re: Another AI chatbot

Post by frankinstien »

Well, I've been thrown out of several worlds on SL for the dumbest reasons, where one time I was naked but the avatar doesn't have genitalia so who cares, apparently the long timers on SL, where some have been there nearly 20 years! The graphics suck big time, I mean big time. So what to do? Well, how about hijack an existing game, like GTA? Yeah GTA, no language limitations, do WTF you want! 8). So you can mod characters' facial features and have it look as best you can like your doll, you can also import pedestrians which are NPCs and you can import a custom character from a face scan. Someone actually made a mod where NPCs could talk using LLMs, but the mod was taken down because of a DMCA request by Take-Two who is the parent company of Rock Star, but all that means is it's possible to do, you just probably need to play the game offline when you do use the mod. Ultimately we the people need an open source high-quality VR World engine where LLMs can play characters and create stories that can be acted out in such worlds. We need to be freed, the Matrix is being controlled by Big Brother and big corps


facescan
Custom Peds


Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

Horrible. Hacking existing games is a good idea, but definitely lots of IP issues everywhere. I'm not sure I could even publish this bot program on github. It's probably fine as long as I don't try to make money off it, but I'd probably have to say it's just a role playing app.

I was trying ReadyPlayerMe which allows you to take a picture of your doll and export a free low poly version of it in .GLB format that can be edited in CAD software.

With that, I should be able to import into Unity and then use OpenAI-Unity. It looks like you should be able to point to a local LLM by editing -

https://github.com/srcnalt/OpenAI-Unity ... enAIApi.cs

Or, I might just import in the GLB file into VRChat and make a private server that allows adult content maybe. They seem to be fine with it.

Also was looking at VR Hot - https://www.vr-hot.com/. It looks like you can import custom models, but it's $10 a month. But they seem to keep updating it at least.

User avatar
frankinstien
Doll Advisor
Doll Advisor
Posts: 568
Joined: Thu Jan 07, 2021 2:25 am
Contact:

Re: Another AI chatbot

Post by frankinstien »

Here's an interesting project integrating LLMs to NPCs for any game!

I also discovered Panda3D

I asked Claude to create an example for a SL like VR world using Panda3D, the actual code is below the summary:

I'll help you create a basic 3D virtual world framework using Panda3D. We'll create a foundation that can be expanded into a Second Life-style simulation.
Basic Virtual World Framework with Panda3DClick to open code
I've created a basic virtual world framework using Panda3D that includes several essential features you'd need for a Second Life-style simulation. Here's what the code includes:

Basic 3D Environment:


A ground plane for the world
Basic lighting setup with ambient and directional lights
A simple avatar (using the smiley model as a placeholder)


Core Systems:


Collision detection framework
Basic physics (simple gravity)
Camera setup and positioning
Window management


User Interaction:


WASD controls for movement
Space bar for jumping
On-screen control display

To run this code, you'll need to:

Install Panda3D (pip install panda3d)
Have basic 3D models available (you can use Panda3D's sample models for testing)

To expand this into a more Second Life-like experience, you might want to add:

Networking capabilities for multiplayer
Avatar customization
Building/creation tools
Inventory system
Chat system
More sophisticated physics
Terrain system

Would you like me to expand on any of these features or help you implement a specific aspect of the virtual world?
from direct.showbase.ShowBase import ShowBase
from direct.actor.Actor import Actor
from direct.task import Task
from direct.gui.OnscreenText import OnscreenText
from panda3d.core import Point3, Vec3, CollisionTraverser, CollisionNode
from panda3d.core import CollisionSphere, CollisionHandlerQueue
from panda3d.core import AmbientLight, DirectionalLight
from panda3d.core import WindowProperties

class VirtualWorld(ShowBase):
def __init__(self):
ShowBase.__init__(self)

# Set up window properties
props = WindowProperties()
props.setTitle('Virtual World')
props.setSize(1024, 768)
self.win.requestProperties(props)

# Set up camera
self.camera.setPos(0, -20, 4)
self.camera.lookAt(Point3(0, 0, 0))

# Create ground plane
self.ground = self.loader.loadModel("models/plane")
self.ground.reparentTo(self.render)
self.ground.setScale(100, 100, 1)
self.ground.setPos(0, 0, -1)

# Set up lighting
ambientLight = AmbientLight("ambient")
ambientLight.setColor((0.2, 0.2, 0.2, 1))
self.ambientNP = self.render.attachNewNode(ambientLight)
self.render.setLight(self.ambientNP)

directionalLight = DirectionalLight("directional")
directionalLight.setColor((0.8, 0.8, 0.8, 1))
directionalLightNP = self.render.attachNewNode(directionalLight)
directionalLightNP.setHpr(45, -45, 0)
self.render.setLight(directionalLightNP)

# Set up collision detection
self.cTrav = CollisionTraverser()
self.groundHandler = CollisionHandlerQueue()

# Set up player avatar
self.avatar = self.loader.loadModel("models/smiley")
self.avatar.reparentTo(self.render)
self.avatar.setPos(0, 0, 0)
self.avatar.setScale(0.5)

# Set up avatar collision detection
avatarCollider = self.avatar.attachNewNode(CollisionNode('avatarCollider'))
avatarCollider.node().addSolid(CollisionSphere(0, 0, 0, 1))
self.cTrav.addCollider(avatarCollider, self.groundHandler)

# Set up keyboard controls
self.keyMap = {
"forward": False,
"backward": False,
"left": False,
"right": False,
"jump": False
}

self.accept("w", self.updateKeyMap, ["forward", True])
self.accept("w-up", self.updateKeyMap, ["forward", False])
self.accept("s", self.updateKeyMap, ["backward", True])
self.accept("s-up", self.updateKeyMap, ["backward", False])
self.accept("a", self.updateKeyMap, ["left", True])
self.accept("a-up", self.updateKeyMap, ["left", False])
self.accept("d", self.updateKeyMap, ["right", True])
self.accept("d-up", self.updateKeyMap, ["right", False])
self.accept("space", self.updateKeyMap, ["jump", True])
self.accept("space-up", self.updateKeyMap, ["jump", False])

# Add movement task
self.taskMgr.add(self.moveAvatar, "moveAvatarTask")

# Display controls
self.displayControls()

def updateKeyMap(self, key, value):
self.keyMap[key] = value

def moveAvatar(self, task):
dt = globalClock.getDt()

if self.keyMap["forward"]:
self.avatar.setY(self.avatar, dt * 5)
if self.keyMap["backward"]:
self.avatar.setY(self.avatar, -dt * 5)
if self.keyMap["left"]:
self.avatar.setX(self.avatar, -dt * 5)
if self.keyMap["right"]:
self.avatar.setX(self.avatar, dt * 5)
if self.keyMap["jump"]:
self.avatar.setZ(self.avatar.getZ() + dt * 5)

# Simple gravity
if self.avatar.getZ() > 0:
self.avatar.setZ(self.avatar.getZ() - dt * 9.8)

return Task.cont

def displayControls(self):
OnscreenText(
text="Controls:\nW: Forward\nS: Backward\nA: Left\nD: Right\nSpace: Jump",
pos=(-1.3, 0.9),
scale=0.07,
align=1,
fg=(1, 1, 1, 1)
)

# Run the virtual world
world = VirtualWorld()
world.run()

User avatar
frankinstien
Doll Advisor
Doll Advisor
Posts: 568
Joined: Thu Jan 07, 2021 2:25 am
Contact:

Re: Another AI chatbot

Post by frankinstien »

Took a look at assetstore.unity.com and was very impressed with the models there, particularly the city builders, wow, just what I wanted that Blade runner like environment. But, I read over Unity's license and sexual content is a problem. However, many say they don't really enforce it but you never know. Panda3D's license which is the Modified BSD License there is no such restrictions. Now if I can only import those city builders into Panda3D...


[youtube]RPy_2S1ZnuQ&t[/youtube]

https://www.youtube.com/watch?v=RPy_2S1ZnuQ&t=7s

Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

Sounds like a good option. Unity probably doesn't go after personal use cases but then you can't sell it. If the chatwaifu program on steam supported 3D avatars that you could customize, I'd get it. I dont see any other LLM games on steam but plenty of sexual content. Seems like unreal engine is fine with it as long as you comply with laws but then they get a cut I think.

Claude is awesome, but I think they recently cut their context window for the free tier :x


User avatar
frankinstien
Doll Advisor
Doll Advisor
Posts: 568
Joined: Thu Jan 07, 2021 2:25 am
Contact:

Re: Another AI chatbot

Post by frankinstien »

Wow! I mean Wow! I have rediscovered Virt-a-Mate. I signed up with them way back, not sure how long ago but it was not something I was too interested in at the time. But now? Now it's a crazy badass platform for virtual Sex, it already has an AI component to it but a subscription is about $20 bucks and is limited to language, TTS, STT, no vision or listening to music, and facial expression recognition. But the platform already has plugins for VR using Quest and others, there's no limit on the type of scenes you can create and the graphics are stellar! You can even import a custom character that looks like your doll! There are cloths available, furniture and stuff to set up scenes, complete environment scenes. Just Wow!

It's hilarious that doll manufacturers haven't built on top of this seasoned platform. It's not user-friendly yet, there's a pretty steep learning curve, but that's how you can add value to the platform is building something that helps automate stuff and/or seup hardware with all the bells and whistles to make it work out of the box!

Going to tingker with this a bit, my Thanksgiving week is going to be busy.

Here's a real-time rendering of a character just starting up, I'm using an older 1060 graphics card, my Ryzen mb hasn't arrived yet, but even with this much older GPU the graphics are leaps and bounds better than second life!

Image

Barfalamule
Active Poster
Active Poster
Posts: 59
Joined: Tue May 14, 2024 1:36 pm
Contact:

Re: Another AI chatbot

Post by Barfalamule »

That looks really good. Much more open than VR Hot it looks like but more of learning curve. Looks like they're coming out with VAM2 soon. I might try the current versions to learn, but probably will get 2nd version once released and new desktop system. It looks like they are using Unity 6 in VAM2.

Also messing with ESP\Arduino. Would like to get some basic touch sensors setup for program. I was hoping an ESP8266, servo, battery and 3D printed tongue would fit in ROS mouth. It does but not with power supply I have.

Post Reply

INFORMATIONS