Another AI chatbot
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
Load my mulitmodal system(currently building) with a Linux Ubuntu with VR character setup and hacks to Moaning sensor functions to the rig, along with arduino wireless eye insert cameras, speaker and mic accessories for the doll, this becomes an interesting product that I think there is a demand for even at a price point of 4K-5K dollars. I'm also looking at creating a SL avatar ability to this rig where it becomes an autonomous entity, so you give your Ai girlfriend or wife a budget of Linden dollars where she can spend it on cloths she thinks will turn you on when you go on dates in the VR world, lol. Upgrading the graphics of the Sl world would be a next phase project, but that would be a fullfledged MMORPG, but baby steps first. Of course building something that could work with Oculus Quest 3 would be nice too.
BTW I've joined the Discord development group of Utopia Skye which is an OpenSim VR world branch, talking to them about how the api can work or extend it for AI character role playing.
So, this approach makes more sense than any of the robot sex dolls solutions today and as sex robotics improves the AI rig can integrate to those systems. If this takes off then it could be a defacto standard to provide interfacing to this rig from doll manufactures.
Yeah, yeah, I'm dreaming, but this is a pretty cool dream...
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
Full end-to-end uncensored speech, SL and AR\VR options would be beyond what doll manufacturers can do for awhile since they aren't shipping GPUs.
Not a bad dream! Mine is still trying to get F5 TTS working with current bot, getting a 16GB vid card and maybe build a custom auto sucking device using Arduino, some 4mm air hose, pump and activate via voice commands.
- Technician
- Doll Mentor
- Posts: 1054
- Joined: Thu Jun 24, 2004 12:00 am
- Location: U.S.A
- Contact:
Re: Another AI chatbot
140cm Sasy Amazon doll. Purchased: 5/14/2019, Measurements: K - cup / 31K - 19 - 25 @ 51 lbs
125cm Amazon doll. Purchased: 3/24/2024, Measurements: G - cup / 26G - 17 - 25 @ 39.8 lbs
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
Here's a update for bot program using F5 TTS. I just got it working a bit ago so not a full update. I need to work on GUI parts to select the wav file for voice cloning and text fields, but it works right now with it just in the code
Using Chatwaifu 13B with 75% offload, stable diffusion, Whisper base and F5 TTS, I'm getting less than 30 second response times on a 8GB GPU. Might finally need to get the 16GB GPU.
F5 is pretty good for local voice cloning and copies the emotion of the audio file you use, so you could make a bunch of profiles for different agents\dolls
- Attachments
-
- F5Instructions.docx
- (2.38 KiB) Downloaded 5 times
-
- F5-TTSbot.docx
- (20.55 KiB) Downloaded 5 times
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
- Attachments
-
- F5Bot.docx
- (20.88 KiB) Downloaded 5 times
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
My main system has just gone bad and I am in the mists of troubleshooting it. Replacing the motherboard, if that doesn't work then new cpu. I'm taking a risk on a MB from China that's below $200, a new cpu is $500. For $500 I'm thinking of maybe using the fuckbot system I described earlier, but that solution only has 4 dimm slots for memory, there are no MB with more slots so I would be compromising to 128GB of memory over the 256 GB I have now. At least I won't need to buy memory or drives, for the fuckbot solution which means I can implement a cpu with more cores but it won't be as powerful as the Threadripper 3960X I have now. As a main system that would suck so hoping the replacement MB works, cross your fingers.
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
facescan
Custom Peds
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
I was trying ReadyPlayerMe which allows you to take a picture of your doll and export a free low poly version of it in .GLB format that can be edited in CAD software.
With that, I should be able to import into Unity and then use OpenAI-Unity. It looks like you should be able to point to a local LLM by editing -
https://github.com/srcnalt/OpenAI-Unity ... enAIApi.cs
Or, I might just import in the GLB file into VRChat and make a private server that allows adult content maybe. They seem to be fine with it.
Also was looking at VR Hot - https://www.vr-hot.com/. It looks like you can import custom models, but it's $10 a month. But they seem to keep updating it at least.
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
I also discovered Panda3D
I asked Claude to create an example for a SL like VR world using Panda3D, the actual code is below the summary:
I'll help you create a basic 3D virtual world framework using Panda3D. We'll create a foundation that can be expanded into a Second Life-style simulation.
Basic Virtual World Framework with Panda3DClick to open code
I've created a basic virtual world framework using Panda3D that includes several essential features you'd need for a Second Life-style simulation. Here's what the code includes:
Basic 3D Environment:
A ground plane for the world
Basic lighting setup with ambient and directional lights
A simple avatar (using the smiley model as a placeholder)
Core Systems:
Collision detection framework
Basic physics (simple gravity)
Camera setup and positioning
Window management
User Interaction:
WASD controls for movement
Space bar for jumping
On-screen control display
To run this code, you'll need to:
Install Panda3D (pip install panda3d)
Have basic 3D models available (you can use Panda3D's sample models for testing)
To expand this into a more Second Life-like experience, you might want to add:
Networking capabilities for multiplayer
Avatar customization
Building/creation tools
Inventory system
Chat system
More sophisticated physics
Terrain system
Would you like me to expand on any of these features or help you implement a specific aspect of the virtual world?
from direct.showbase.ShowBase import ShowBase
from direct.actor.Actor import Actor
from direct.task import Task
from direct.gui.OnscreenText import OnscreenText
from panda3d.core import Point3, Vec3, CollisionTraverser, CollisionNode
from panda3d.core import CollisionSphere, CollisionHandlerQueue
from panda3d.core import AmbientLight, DirectionalLight
from panda3d.core import WindowProperties
class VirtualWorld(ShowBase):
def __init__(self):
ShowBase.__init__(self)
# Set up window properties
props = WindowProperties()
props.setTitle('Virtual World')
props.setSize(1024, 768)
self.win.requestProperties(props)
# Set up camera
self.camera.setPos(0, -20, 4)
self.camera.lookAt(Point3(0, 0, 0))
# Create ground plane
self.ground = self.loader.loadModel("models/plane")
self.ground.reparentTo(self.render)
self.ground.setScale(100, 100, 1)
self.ground.setPos(0, 0, -1)
# Set up lighting
ambientLight = AmbientLight("ambient")
ambientLight.setColor((0.2, 0.2, 0.2, 1))
self.ambientNP = self.render.attachNewNode(ambientLight)
self.render.setLight(self.ambientNP)
directionalLight = DirectionalLight("directional")
directionalLight.setColor((0.8, 0.8, 0.8, 1))
directionalLightNP = self.render.attachNewNode(directionalLight)
directionalLightNP.setHpr(45, -45, 0)
self.render.setLight(directionalLightNP)
# Set up collision detection
self.cTrav = CollisionTraverser()
self.groundHandler = CollisionHandlerQueue()
# Set up player avatar
self.avatar = self.loader.loadModel("models/smiley")
self.avatar.reparentTo(self.render)
self.avatar.setPos(0, 0, 0)
self.avatar.setScale(0.5)
# Set up avatar collision detection
avatarCollider = self.avatar.attachNewNode(CollisionNode('avatarCollider'))
avatarCollider.node().addSolid(CollisionSphere(0, 0, 0, 1))
self.cTrav.addCollider(avatarCollider, self.groundHandler)
# Set up keyboard controls
self.keyMap = {
"forward": False,
"backward": False,
"left": False,
"right": False,
"jump": False
}
self.accept("w", self.updateKeyMap, ["forward", True])
self.accept("w-up", self.updateKeyMap, ["forward", False])
self.accept("s", self.updateKeyMap, ["backward", True])
self.accept("s-up", self.updateKeyMap, ["backward", False])
self.accept("a", self.updateKeyMap, ["left", True])
self.accept("a-up", self.updateKeyMap, ["left", False])
self.accept("d", self.updateKeyMap, ["right", True])
self.accept("d-up", self.updateKeyMap, ["right", False])
self.accept("space", self.updateKeyMap, ["jump", True])
self.accept("space-up", self.updateKeyMap, ["jump", False])
# Add movement task
self.taskMgr.add(self.moveAvatar, "moveAvatarTask")
# Display controls
self.displayControls()
def updateKeyMap(self, key, value):
self.keyMap[key] = value
def moveAvatar(self, task):
dt = globalClock.getDt()
if self.keyMap["forward"]:
self.avatar.setY(self.avatar, dt * 5)
if self.keyMap["backward"]:
self.avatar.setY(self.avatar, -dt * 5)
if self.keyMap["left"]:
self.avatar.setX(self.avatar, -dt * 5)
if self.keyMap["right"]:
self.avatar.setX(self.avatar, dt * 5)
if self.keyMap["jump"]:
self.avatar.setZ(self.avatar.getZ() + dt * 5)
# Simple gravity
if self.avatar.getZ() > 0:
self.avatar.setZ(self.avatar.getZ() - dt * 9.
return Task.cont
def displayControls(self):
OnscreenText(
text="Controls:\nW: Forward\nS: Backward\nA: Left\nD: Right\nSpace: Jump",
pos=(-1.3, 0.9),
scale=0.07,
align=1,
fg=(1, 1, 1, 1)
)
# Run the virtual world
world = VirtualWorld()
world.run()
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
[youtube]RPy_2S1ZnuQ&t[/youtube]
https://www.youtube.com/watch?v=RPy_2S1ZnuQ&t=7s
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
Claude is awesome, but I think they recently cut their context window for the free tier
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
- frankinstien
- Doll Advisor
- Posts: 568
- Joined: Thu Jan 07, 2021 2:25 am
- Contact:
Re: Another AI chatbot
It's hilarious that doll manufacturers haven't built on top of this seasoned platform. It's not user-friendly yet, there's a pretty steep learning curve, but that's how you can add value to the platform is building something that helps automate stuff and/or seup hardware with all the bells and whistles to make it work out of the box!
Going to tingker with this a bit, my Thanksgiving week is going to be busy.
Here's a real-time rendering of a character just starting up, I'm using an older 1060 graphics card, my Ryzen mb hasn't arrived yet, but even with this much older GPU the graphics are leaps and bounds better than second life!
-
- Active Poster
- Posts: 59
- Joined: Tue May 14, 2024 1:36 pm
- Contact:
Re: Another AI chatbot
Also messing with ESP\Arduino. Would like to get some basic touch sensors setup for program. I was hoping an ESP8266, servo, battery and 3D printed tongue would fit in ROS mouth. It does but not with power supply I have.