Silgen - ai image generation for paintable objects in rust.

[Harley Ross]

I have a working prototype of silgen working on my rust server right now. 

 

It acts like /sil but allows you to prompt a locally running portable version of comfyui. It can send requests to comfyui and and recieve the call back from comfyui and paste the generated image on the sign, painting, photo or pumpkin. Using the command: /silgen large old stone castle in the woods.

 

There is also a text option since ai isnt very good at text, we use a second node to add text when needed. Via the command: /silgen text your text here | large green field of trees with the sun high in the sky.

This generates the text and image separatly and combinds them after. 

In /silgen help you can change the generation scale so you can generate a 2x the resolution. The plugin automatically scales the image to fit the surface you're painting on. It also has preset buttons for fantacy, western etc... as well as text options like font, font size and spacing, text color, etc.. 

 

Right now i have it running on a 3060 12gb and each generation take less than 4 seconds. The plugin has a built in que system with fully adjustaable cooldown and permission settings.

 

Screen shots and video links to come. If you want to try it out in game. Connect to www.westcoastrust.org   its a 10x pve server with kits and easy to start on. Make some signs and test out /silgen for yourself. 

Edited 1 hour ago by Harley Ross

[Harley Ross]

I've tested all my cards on a couple of specialized low step models that are ment for fast generation times. These are the times on several Nvidia cards including some very old cards, so you dont need to spend a ton of money on a gpu to add this feature to your server.

 

 

Notes:

 

The 30 step model is a full size not optimized meodel. Way more than what silgen requires.

 I feel like 20ish seconds is about as long as you would ask a player to wait for an image to generate, so you dont really need to spend big money on a gpu for this project.

You can see that even a 1060 using the 4 step lihtning model will get the job done in a reasonable time.

Edited 24 minutes ago by Harley Ross