Unexpected byte in an encoded string

[SilverTemplar]

Hi!
I have a problem with Amadeus, when I try to open the SG0_00_02.scx file from the Steins;Gate 0 script I get the following error:

"Unexpected byte in an encoded string: 19"
I'm not a C# programmer (I do not even have a high level in another language) and I'm still learning about reverse engineering so I do not understand much of the code or how SC3 works.

This happens with some files like the one already mentioned (SG0_00_02.scx) and also others like RN01_00A.scr and RN01_01A.scr of Robotic;Notes however others like RN01_02A.scr of Robotics or SG0_00_01.scx of Steins 0 are read perfectly.

Is it solvable? Unsolvable?
Thank you.

[sa-exe]

Hi.
Good to know someone's interested in this project. Though, as you can see, there's no license, no docs, not even a readme. Basically, it's just a pile of code I'm working on. None of this stuff is baked. So keep that in mind.

As for the issue, I've known about this. It's already been fixed locally. Though I can't guarantee those changes will make it to the repo in the nearest future. I've made so many changes to the SC3 library that Project Amadeus won't even compile in the current state. I'll get back to it this month. Sorry it's taking so long.

[SilverTemplar]

@SomeAnon42 Thank you so much for taking the time to answer!
Yes, I'm quite interested in the project, trying to find out how it works, I'm not a C # programmer nor do I have an advanced level in another language... I also do not know much about reverse engineering so ... I'm not experienced on this subject.

Although I love messing with these things and go learning slowly, I've been the last five days trying to figure out exactly how the SC3 but without much success.

I've been trying to translate Robotics;Notes (vita version and I guess then it would be easy to port it to PS3).

Using project amadeus I was able to introduce and translate part of the text of the game and it worked perfectly in the vita.

The problem was that the prologue was one of those files that gave "Unexpected byte error" and I couldn't translate that part. Would you be able to guide me or give me some reference to understand or figure out myself how the SC3 work? I am very interested in learning all this but I am a bit confused about where to start... for now I am with C# in order to understand your code.

Sorry for all those questions, this is the last one:
When I open some of the Robotics files this is what happens

Is this due to some problem with the charset or simply that the Robotics SC3 is slightly different? (I ask out of curiosity).

Sorry for all the noob questions and thanks.

[LennyGrandin]

Please do take into account the fact that I'm lurking here ha ha. Information about the script format (or even any information) could save me from hours of analysis!

[drdaxxy]

Robotics;Notes uses a different character set than S;G Steam and S;G0 (which is why your screenshot is showing garbage) and some escape sequences SciAdv.Net.SC3 isn't aware of yet (which is why you're getting "Unexpected byte error" on some files). This will take reverse engineering of R;N to fix.

These tools aren't really meant for public consumption yet and we're busy with other stuff right now, but we're generally willing to do this for serious translation projects.

vita version and I guess then it would be easy to port it to PS3

Wouldn't count on it; there are probably internal changes between R;N and R;NE that make the Vita script and assets incompatible with the PS3 version. In which case porting isn't exactly impossible but a significant undertaking nonetheless.

[drdaxxy]

@Mol-du I doubt we'll get to documenting anything anytime soon; you're probably better off asking specific questions in chat.

[SilverTemplar]

Thanks for the reply!

Regarding the character set, it is no longer a problem, I was able to map most of it using reverse engineering.

I am already developing my own tools for R;NE which, for the moment, are allowing me to insert text without problems.

For now I am dealing with the text font files of the game in order to be able to enter special characters.
And I agree on the port to ps3, my tests have not given more results than failures.

Your tools have helped me a lot to understand the SC3, thank you!

[drdaxxy]

Let me just dump this charset here. Will be a while until we integrate it (if at all), but it exists now, so might as well at least post it...

RoboticsNotes_Charset.utf8.txt

[SilverTemplar]

Thanks for the charset, it saved me a lot of time.
Do you know in which file the characters of R; N can be edited? I need to add additional characters.
thanks in advance.

[drdaxxy]

There's a font file (id 12 in system.cpk). Though the game only treats hardcoded ranges of characters as proportional, with hardcoded widths, and hardcoded ranges of characters as word characters (for the purpose of wordwrapping). So you'll have to analyse and patch the game code for that to look good.

[SilverTemplar]

Thank you very much for the answer (I couldn't find the specific file) I'll start analyzing it later to see if I can do anything.

[Nishikino]

Is there a big difference between the supported script files and ones from Linear Bounded Phenogram on Vita? Not having any luck with those with Project Amadeus.
I understand these tools aren't for public use yet, so I'll definitely be keeping an eye out for any updates. 👍

Thanks!

[SilverTemplar]

@Nishikino I can open them in amadeus but the charset (I am using the S;G charset) doesn't seem to be the right one...

[Nishikino]

@SilverTemplar Wow how did you manage to do that? I tried using the supported modules gen etc. and recompiling Amadeus with that but no dice. Granted I don't really know what I'm doing haha, just messing around with it all.

But that's a step in the right direction, besides I wouldn't even know where to begin to dump the charset...

[SilverTemplar]

@Nishikino I simply generated the modules for the script and then added the folder for phenogram in the "SciAdv.Net-master\src\SciAdvNet.SC3\Data" directory.

In the file "SC3Game.cs" I added the name of the folder and set the files (of the folder) as "Embedded Resource".

The charset I copied it from the steinsgatehd folder (I also tried with the steins 0 and the robotics but they did not seem to coincide).

On dumping the charset I know how to do it based on "brute force and trial and error" but I do not know an efficient method to do so, I'm still trying to modify the font file of Robotics;Notes to add special characters, maybe drdaxxy can answer you better to this.

I'm sorry if this is badly written in English or difficult to understand, I'm writing in a hurry (and my writing level is not very good anyway ...)

[Nishikino]

@SilverTemplar Thanks for the help, that worked!

@drdaxxy Sorry to bother you, but I'm just curious what the general method is to dump the charset? I see you did it for Robotics;Notes