VTS P.O.G.
A downloadable vtube studio plugin for Windows
Vtube Studio Processor of Gossip or VTS-POG for short, its a plugin to connect text to speech to Vtubestudio live2d models, png pets with browser sources and 3D pets.
NOW SUPPORTING CHAT GPT TOO!
Here you can see it in motion:
For Live2D pets, this plugin creates 4 new mouth params for Vtube Studio, that behave as similar as possible to the default ones.
This parameters are:
- VoiceVolume2
- VoiceVolumePlusMouthOpen2
- VoiceFrequency2
- VoiceFrequencyPlusMouthSmile2
For png pets, just download our browser sources and replace the images with ones from your pets. Then drag and drop it to obs and its done!
With this plugin, you can easily have an onscreen live2d item pet or png pet that will speak whatever text you send through the tts.
Or whatever text your chat says! It has twitch integration with support to channel points, bits/cheers and subscriptions so chat can speak through your on screen pet or avatar.
You are not an affiliate? Not a problem! It also supports chat commands!
You stream on youtube? We have support for youtube streaming too!
Model wise, the plugin is compatible with most live2d models! You just need to replace their default mouth input parameters with the new ones from the plugin. If you want to test it as is, the zip includes a test model for you to use or edit as needed, you can also find it on steam workshop for VTS!
It supports more than 10 different languages between Streamelements TTS and Amazon TTS, with plans to expand to many more languages and TTS services in the future~
For inquiries, suggestions and help, please feel free to join our discord server over here https://discord.gg/cCXksNG8fY
IMPORTANT NOTE: For tts only usage, vtspog comes included with a pogu-kun as png, 3d and live2d pet and connections to free tts services that function out of the box with no extra charges. Vtspog also connects to different services like chatgpt, elevenlabs or tts.monster that may have extra fees or limitations in order to use them. Feel free to ask and reach out to us for any inquiries about the different options.
Also thank you so much to all the beta testers ♥♥♥
Some helpful tutorials:
Installation process
Setting up point redeems on twitch
Configuring a model from scratch
Check suggestions and in-work features over at our trello
Purchase
In order to download this vtube studio plugin you must purchase it at or above the minimum price of $15 USD. You will get access to the following files:
Development log
- VTS P.O.G. 2.0.18 is out!Apr 24, 2024
- 2.0.5 Audio output hotfixDec 08, 2023
- Version 2.0.4 out! Hotfixes for really specific issues!Dec 07, 2023
- Version 2.0.0 and a year of VTS P.O.G.!Dec 05, 2023
- Version b1.0.8 is out! more hotfixes!Jul 22, 2023
- VTS P.O.G. b1.0.7Jul 15, 2023
- Hotfixes! VTS P.O.G. b1.0.6 is out!Jul 04, 2023
- AI uprising! VTS P.O.G. b1.0.5 is out with ChatGPT Integration!Jun 30, 2023
Comments
Log in with itch.io to leave a comment.
I can't get VTS pog to start up
heya! thats super werid! You can find a link to our discord server on the main page https://vtspog.com , feel free to make a thread on support there and we can give ya a hand over there to try to make it work. I'm positive we can figure it out if we check it out together ♥
How do I update? I can't seem to find it anywhere
heya! you need to download the new version and just unzip the file and either replace the folder or delete the old one and just use the new one. VTS P.O.G. saves configuration on windows appdata so configs carry over between versions, they are not saved on the vtspog folder..
doesnt seem to run through crossover on mac, window with the program is just non existent with no plugin pop out in vts…
little experience myself in mac development so I wouldnt even know where to start with that, sadly a bit outside of my knowledge as a developer. I'm planning on getting a mac around February (hopefully) to adapt vtspog for mac cause I don't even have one myself and are a bit hard/expensive to get where I live (Argentina)
i would try looking at another vts plugins with mac support for reference
Looking forward to seeing a Linux version!
not a linux user myself, so low experience in adapting it to it BUT one of our users made a guide on how to run it on linux. I wasnt able to try it myself, but seems to be working after many hoops! Let me link the video they made going through their setup here
Thanks for the reply. I'm familiar with Lutris but I don't believe I had tried it for VTS-POG.
I'll give this a shot later and report my findings.
let me know how it goes ♥
Lutris+Proton-GE was the trick!
I was given a free copy to test with some months back that I couldn't get working.
Now that I have this running, I'm buying a copy.
Still would be great to see a native Linux version but this definitely helps!
This the best thing. Thankyou so much for your help and thankyou so much for making this
I want to buy it. But I want to know if can user local llm models
not atm, but ollama support is in the works, so far the most stable option for local llm I have found. If you know coding, you can also send generated responses to vtspog through our local api, but the setup may be a bit complex unless you are confident in your python (given most local llm model solutions run in python)
for the openai stuff why just make the b ase url customizable so we can use lmstudios server
also add support for coqui tts or add support to use use xtts-api-server https://github.com/daswer123/xtts-api-serverThanks I will be wait then ^^
if they use the openai api we the base url can be changed and can run a server with lmstudio that be dope if they can update and use xtts-api-server also
didnt know about lms studio or coqui so i would need to give em a check, but I'm always open to suggestions. Will try giving em a look once I have the time~
is it possible to change the gpt model? i was hoping to use the new 4o mini model
next release! its already available in a test build Im sharing for testing, hit me in the dms on the discord server and I dont mind sharing it ♥
As a vtuber I'm interested in this program, since it looks cool and also interesting way to interact with a chat.And also, I saw the Vnyan integration on twitter.
But do you plan any language update? For example Ukrainian? Unfortunately, not so many TTS working with this language and it's a bit upset.
heya! sadly the vast majority of voices available around are in english, the market is way too focused there. We have in streamelements and azure tts voices in ukranian but only 3 with them added up (and quality tbh cant compare to the english ones). So we have some ukranian voices, just not many D:
Hello! I have a ton of recorded lines by my hubby for my mascot. Is there anyway to have my stream deck pipe that audio and have his mouth move? Or should i plan on getting a basic animated mouth. Thank you!
heya! yep, vtspog can play arbitrary audio files. Either by api request or by setting em on the soundboard and triggering em using the keyword you set for em. Feel free to make a thread on the discord server support or ping me in discord dms and i can explain to ya a bit better there if its not clear enough with this ~
So is this strictly just used as a TTS program or can it also be used as an AI that can answer questions/comments on its own?
both! atm only typed messages either in chat or in the program itself. We are adding microphone support in the near future too ~
So cool!!!! I'll have to get this program when I can!
Do you will make it compatible with Ollama Api too, for people who want free option of chatbot?
most likely! doing some tests with it lately and happy with what im seeing so far :D ♥
i have worked a bit with ollama api there were some months. So if you want some views from other people about it, i will be glad to talk about it with you in prevate message.
feel free to contact me on discord and/or twitter, input and suggestions are always appreciated ♥
Hi! for some reason the sound just cuts off all together when i try to run the TTS. its not coming out of the program. when it was working everything was fine but then it just stopped and no matter what i do and no matter how many times i reinstall it i cant hear anything anymore
to be more precise, it wont work at all sound wise. the models mouth is either stuck open till i uninstall it or it wont even talk at all.
heya! sounds like an issue with the audio output. Go to audio settings in vtspog and select the output to be your output device of choice (headphone or spealers) and make sure it doesnt have "default" in its name when selecting it. Windows sometimes does some weird stuff when vtspog tries to access devices listed as that (they should appear listead twice, one normally and one with the "default" in the name). After selecting it remember to click the button "select device" on the top right and then save vtspog. Once it finished saving, restart vtspog and see if that did the trick.
Also when opening vtspog check if the green message that says vtspog started correctly appears after doing that.
Try that, and if it doesnt work create a thread over at our discord server (you can find the link in vtspog itself at the bottom of the left menu). If you are reading this on the 9th I probably wont be able to check that today but hopefully tomorrow on the 10th i can check it in detail. I'm confident we will be able to fix it together if so ♥
Are you going to eventually make it compatible with Tangia TTS?
it already is! if you have both tangia and vtspog open at the same time, tangia sends the tts over to vtspog to be played. Should work automatically~
It doesn't for me. Do I have to select something other than StreamElements? Since Tangia itself is not an option.
as long as you have the tangia overlay open on obs/streamlabs desktop at the same time, tangia should send the tts over to vtspog . TTS setup must be done on tangias side, and when a tts from tangia is played, it will be played in vtspog instead. You can find our discord server link at the bottom of vtspog menu, if you are still having trouble feel free to come over to the server, make a thread in support showing whats your setup atm and we can see from there (much easier to check stuff there than in comments here)
Its a way to have two Redeem with twitch channel points? Like one for subcribers and another for non subs, and if its posible having a png for each one
heya! not possible atm to have two tts png pets. The support for multipets that we have is by role separation atm: one pet for normal tts, one pet for soundboard sounds, one pet for ai with chatgpt. Support for more pet like multiple ai/tts ones is planned for the future though
i cant keep it on a set voice, it changes each time, how do i fix that
heya! same bunni on the server support threads right? just to make sure we are helping you out already ♥
Hi! I have been having problems with this program! It keeps messing with my audio where when it is used, instead of me hearing the text to speech, I'll hear either the game blaring into my ear or the say music blaring into my ear. How do I fix this?
heya! I think i saw your thread earlier on our discord. Please send me the stuff I ask ya there and we can try to fix it together. It does sound quite weird indeed! Never heard of anyone having a similar issue thats for sure
Hi, I've been having trouble with VTS P.O.G. not announcing sub events like gifts or the tts that should go off when someone resubs with a message on twitch. Everything is connected. I've disconnected and reconnected from twitch on the app and saved and it just isn't working.
heya! thats so weird! Given what your describe, it will be best if you come over to our discord server and make a thread on support there. When doing so please screen record and share a video showing your twitch configs on vtspog and describe the issue in detail and I will try to help ya as best as I can (my answer may be delayed though, not fully on the PC today I'm afraid)
Hello, I want to know if there is any way to translate the program interface
Heya! Not atm, its in my never ending to do list as something i want to eventually get down to but not atm im afraid
will this connect to kick and tiktok studio in the future??
heya! tittok is in the works! I need to find the time to test it out properly myself before finding testers for it. Kick we are waiting for official API support which is still not out D: so that one will depend on kick mostly, but when they do we will try to add it too!
awesome! im so glad to hear!!! thanks so much for the awesome app 😁
Hi,
I've been wondering if you have any plans on switching the chatgpt to the newest GPT-4o version?
heya! If I find that nothing breaks with it, I will add hopefully for next version an option to select between 3.5, 4 and 4o. It will depends on how well it behaves with what we already have. If it gives us trouble may take longer but is a "yes" in the longrun for sure
Hello! Sorry to bother, but I've been having a problem with my mascot not responding to chatters using my GPT AI redeem. It will work at for a while, but after some time without activity it will start ignoring them and I have to manually go in and chat to my mascot (it starts working again when I do it manually). No banned words are being said so I'm not sure what is causing it. I've been having this issue with the past two versions so far. Tried reverting to the old stable version as well but that didn't fix it either D:
heya! thats super weird indeed. I will ask ya if you can come over to our discord server (link in vtspog itself) and make a thread on the support channel so I can ask you there for more details/screenshots/screen records of the issue so we can figure it out. Feel free to ping me when you do and put a "hey i'm fusushi from itchio" so I know it comes from this. Hopefully we can figure it out together~
Hi there, how would I go about updating the program? (If there's a video you could point me to I'd appreciate that too)
heya! we should probably do a video cause I know quite a few people are having issues figuring that one, sorry for that. You need to check on the top of the screen you should see a download button, just need to download the new version from there. Configurations carry over so you are covered there~
I eventually got it figured out, but thank you for the help!! For some reason when I copied the zip file to the folder, it wasn't replacing the old version, but it's all fixed and working now!!
so weird! glad to know its working now though ♥♥♥
Hello everyone, new user with a dumb question. Is there now or will there ever be support for Kick streaming?
heya~ we are waiting for kick official api support D: they promised it was coming but its been MONTHS. The moment they add it we will connect to it, be sure about that~
Thank you! You good people have done some amazing work and I'm looking forward to what you guys have planned next.
Have a good day, and again THANK YOU!
Hello, I've been using vts pog on my twitch in conjunction with vtube studio and i noticed that after a few hours of inactivity, the program just does not respond when my redeem is used. it will even say there's an error or that it is sold out even though i only have a 5 second cooldown set up for it. However, when i do the audio test from vts pog, it still works as normal. I'm not sure how to fix this. please help.
heya! some people have reported this lately and after some tests it seems the current test build (coming out hopefully monday) should fix it. Feel free to dm me on discord and i can send ya the early build (link to the discord server on vtspog itself) or wait till monday and hopefully that version should fix it. If not, we can check it together and see how to fix it. Sorry for the trouble!
Hi! i wanted to know if there was a way to change the elevenlabs model from english to multilingual v2?
due to a mistake on my part not in this version but yes in the next one, come over to our discord server and dm me and i can send ya the test build to run that. Sorry for the trouble!
Is there gunna be more updates and additions to this?
heya! yes! some small qol and bug fixing update coming soon with a few minor additions, and slowly working on a biffier update for the next couple of months. I'm always open for suggestions for new features ♥ As long as people continue to buy the program (or enough people in the patreon to pay bills) development on the program will continue
thank you!
I dunno if ive just missed it or not, but as with the chatgpt having the option to have the pet read out the message before responding is it at all possible to have the pet say something like " 'viewer' typed/said" then read the following message so its possible to know who triggered the tts without having to look at the chat.
additionally is there any option to change what the pet says in response to raids and subscription?
heya! you want to basically enable these two in that gpt tab to have both the og message and the name read out loud by the pet
also not possible atm to edit the raid and first time subs , but its something we DEFINETLY need to add
Hi there! I set everything up in VTube Studio with the parameters, but the mouth won't open when I do the TTS test. It opens if I use camera tracking, but doesn't move when using VoiceFrequency2/VoiceVolume2. I tried switching them between the two mouth parameters, but one makes the mouth stay shut, and the other makes it to where it only stays open. Do you have any suggestions on how I can fix this?
pretty sure we are already talking on the vtspog discord server, in case its a nickname coincidence do come by there and we will give ya a hand ♥
Is there a way to make it smaller, currently is taken up my full screen and cant get to the things are the bottom of it
if you hover the mouse to the edges you should be able to resize the window. If that is not enough come over to our discord server, link in the icthio page, and we will see what we can do
is there a way to connect this with my veadotube mini
heya! atm not by default, but you can connect it by sending the vtspog output audio as the microphone input for veadotube mini~
Here in our docs we explain how to send vtspog output through a virtual audio cable https://vtspog.com/docs/article/audio-configuration/
And with that set up you basically need to select your virtual audio cable as the input for veadotube mini~
Hey there, I was just wondering if there is a way to just have the TTS respond without reading the chat message?
heya! yes! make sure this two are disable and it will just answer without reading the users message
Thank you so much! <3
Hello, there is an error in (vts-pog 2-0-5.zip) the filters (Dont read emojis, Dont read links) are not activated when you mark them active, continue reading the emotes and links
heya! i cant seem to replicate this issue you mention. If you come over our discord server I would apreciate if you can share a video showing the issue so i can hopefully replicate it myself and fix it. Please make a support thread there so its easier to check and hopefully solve
Hi! Is there any possibility of this working on Linux? Not natively is good too, I'm using Streamer.bot through Wine regularly.
heya! I have zero experience with linux tbh apart from some server stuff and not way to test it myself. If you hit me in dms in twitter i can send ya a key and you can let me know how it goes. If it works i would apreciate a guide or step by step of sorts to guide other users in case they wanna run it too, thats the only condition~
heya! Tenemos algunas voces en español en algunos de los sistemas de tts que tenemos pero no son TANTAS comparado a ingles. El tema de español (bah, cualquier lenguaje que no es ingles ) es que pocos desarrollan voces que no sean en ingles :c asi que haber hay, pero la mayor variedad la encontraras en ingles.
Pero si, se banca español
I think there is a problem with the domain to be able to connect to Twitch since it sends me to another page and I cannot connect
heya! sorry for the trouble! issue should be solved now though due to browser cache issues it may still show as an error until you restart your browser. Try opening the link into an incognito window and it should work correctly (or restart browser/pc). Sorry for the trouble!
thank you very much it already worked
Is there a way to isolate the TTS noise from every other audio source?!
Already answered on discord, but leaving the link here in case someone else has the same question https://vtspog.com/docs/article/audio-configuration/
hello! i have a question even do i think is not possible but is not bad asking, if someone sends a message will the bot be able to read the name of the person and then say what the message of that user said
heya! not by default, we have the ability to include that on the message on the ai responses to differentiate the user message from the ais... wouldn't be impossible to add in the future given is half there atm 🤔
though if you need it/want it now, come over to our discord server and I can guide you how to set that up with mixitup or streamer bot, it would be possible by combining either of those programs with vtspog if you already use either fo them~
I'm really interested in the plugin. I wonder , is it possible to use it for 2 different model.
For exemple one reading chat and another one using chat gpt ?
heya! yeah, we added support to multipet this last update to do exactly that. So you can have one model/png do only ai and another one only tts and soundboard~ I use that setup myself, so that one can stay as a chat surrogate while the other becomes the mean evil ai dissing them and being a meanie (or helpful, but meanie is funnier)
hey is there a listen to mic feature planned?
yes! in the works ♥