.sm to .dwi converter

[Fission]

haha, it's not quite done yet. it will work if you have lua installed on your pc, but i really want to make this a standalone executable.

going to edit the op with what i have so far in terms of code from now on and my future direction.

[TC_Halogen]

Originally Posted by Fission

for those who are interested, here is a pastebin of the source:

http://pastebin.com/MHJtWLXA

some things might be a little sloppy, and i'll work on improving them later. i just wanted to write something that works for now.

this will successfully convert a file named "test.sm" to "test.dwi". this assumes, like silvuh's script, no holds, mines, etc.

i have yet to implement directory searching. going to work on that soon. after that, i'm going to add recursive conversion from a root directory to convert a whole bunch of files at once. that way, everybody can send .sm files to batches instead of having to convert to .dwis

I love you.

[sticklydude]

This is excellent. The .dwi format has never made sense to me. Keep it up 8)

[Zaevod]

Awesome! I was actually thinking about making one myself.

[Silvuh]

Originally Posted by Fission

i'm going to add recursive conversion from a root directory to convert a whole bunch of files at once. that way, everybody can send .sm files to batches instead of having to convert to .dwis

Ohh, I didn't even think about that! Yeah, it would definitely be more convenient to be able to convert all batch files at once than having to make everyone convert their own files before sending them in.

I added the following lines to my script: ("..." is where all the old scripty stuff goes)

Dir.glob("**").each do |folder|
    next if folder =~ /.*\..{1,2}[^\)]$/
    Dir.chdir(folder)
...
    Dir.chdir("..")
end

These lines makes the old script loop through each folder in the directory ... so it now works for batches if you put the .exe in the song superfolder.

Here's the new executable:
http://www.mediafire.com/download/kk.../batchdwi2.zip

Extra notes: It only searches one directory down. The "next if" line is so the script skips any file with any two- or three-character extension without skipping anything ending with ")" (as all files in the batch should; it won't confuse a file with stepartist "asdfk.as" as not being a directory.) Without this line, the script would break when it tries to enter "batchdwi.exe".

I don't know how to make the executable show a pop-up if it catches something that FFR doesn't support in a file, but that should be something the stepartist should check before sending the file in.

... And I don't know how to search directories and files and stuff in Lua, but here's an explanation of what I did in Ruby in case it helps:

filearray = Dir.glob("*.{sm,ds,ssc}")
simfile = open(filearray[0]).read()
dwifile = File.new("#{filearray[0].sub(/\..+/, "")}.dwi", 'w')

This Dir.glob expression saves the file name of every .sm, .ds, and .ssc file in the folder into an array. The next line opens the first entry in the array and reads it (so it will read a .ds file if no .sm is present and only read one file). The next line creates the .dwi file, naming it by substituting the file extension of the simfile with nothing and sticking ".dwi" onto it.

[Choofers]

if I remember VB, I'd convert this to a standalone but the only thing I'm working with is powershell lol

can you package powershell scripts?

[Fission]

Originally Posted by Silvuh

I don't know how to make the executable show a pop-up if it catches something that FFR doesn't support in a file, but that should be something the stepartist should check before sending the file in.

i'm not really worried about this yet. in terms of lua, my approach is probably going to be something along the lines of returning data about the conversion process in a lua table to c and using c to handle said data.

Originally Posted by Silvuh

... And I don't know how to search directories and files and stuff in Lua

http://keplerproject.github.io/luafilesystem/

lua doesn't offer as extensive of a file io library as ruby because it is designed to only include what is maximally portable. luafilesystem isn't quite as portable as the base io libraries, so that's why it isn't included in the standard lua libraries. it will offer all of the functionality i need, though.

[Fission]

updated op. removed some silly unnecessary code and cleaned up some of the structure. going to work on compiling luafilesystem into a c library in the near future.

[Fission]

updated op with new version of the script. recursive searching and converting should work now. going to work on getting a standalone executable out now.

[Wayward Vagabond]

i'll be waiting for that .exe

[Fission]

updated op with standalone executable. i haven't ran this through a very extensive battery of tests, but please let me know right away if it doesn't convert a file with no holds, mines, etc. properly.

[Fission]

discovered a bug thanks to tosh

"—" in filenames will cause the converter to crash on certain language locales. i suspect there are more characters that will cause this behavior. i will look for a solution later.

[Choofers]

I can't think of why that would cause a crash... is that a standard ascii character?

[Fission]

you raise a good point. it is a standard ascii character, so i'm confused as to why it's even an issue if that's the case.

maybe all of the appropriate windows updates aren't applied? not sure right now. will think on it some more.

[Choofers]

edit: https://en.wikipedia.org/wiki/Extended_ASCII

tosh, try converting an sm file with any character above 127 on this table
http://www.ascii-code.com/

[tosh]

Originally Posted by Choofers

edit: https://en.wikipedia.org/wiki/Extended_ASCII

tosh, try converting an sm file with any character above 127 on this table
http://www.ascii-code.com/

Just noticed this.

I've only tried a few, but most of them didn't work. Some of the ones that worked were †, ‡, and ‰. I'm running on a Japanese locale, so I'm kinda surprised ¥ didn't work.

[Fission]

i am not 100% certain, but i think i discovered the cause of this.

lua doesn't support UTF by default. on a japanese locale, for instance, the characters you are having trouble with aren't in the ascii set of characters, so they need to use UTF. i found a fix for this, and will work on it tonight.

[rCaliberGX]

yeah sorry for putting it in the batch thread

so when i put it in the same folder and run, the converter opens and closes in an instant but there's no output.

edit: nvm i found why it didn't show. my sm installation is in program files, and output is in the compatibility files section. it has to be run in administrator mode for output to be in the song folder.

[Fission]

phew. glad you figured it out :D.

i'll add a note about that to the OP in case anybody else runs into that pitfall. thanks for discovering that. guess that's something else i should investigate; i don't think i'll be able to find a work-around for that though.

[Fission]

i'm planning on completely writing the entire script using the penlight lua libraries. in particular, most of the .sm file parsing will be done in the method described in http://stevedonovan.github.io/Penlig...guration_Files. i have spent a lot of time writing my own file parsing when most of the work was already done for me, so i'm just going to use it.

this is going to allow me to convert between .dwi and .sm formats a lot easier so i can write a converter that goes the other direction (.dwi -> .sm) and will allow the converter to be configurable with a configuration file.

also, i created a gist for this script that i'll update the op with when i'm at home so i can give real-time updates as to what i'm doing.