Author Topic: Axe Detokenizer  (Read 3818 times)

0 Members and 1 Guest are viewing this topic.

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Axe Detokenizer
« on: June 25, 2011, 07:35:45 am »
I have been working on an Axe Detokenizer for a while now. Today, with a precious tip Kerm Martian gave me, I manged to finally finish it.

Quote
Axe Detokenizer is an open-source, free, light-weight, simple and easy-to-use TI-83/84+ (SE) Axe Detokenizer. It opens Axe Source Files (.8XP) and makes text files with the detokenized code. It was made in Python and in order to use it, you need Python 2.6 or 2.7 installed. Since it was made using Python, it is also cross-platform, meaning it will work in all major Operative Systems.

To use it, type in the command line:

Code: [Select]
python axedetok.py source.8xp detokenizedcode.txt

In order to know how to use it, you can always try python axedetok.py --help

If you're a Linux user, it should be very easy to setup. If you're a Windows user you will need to have python in your path. To do this, go here.

Both a .zip and a .tar.gz were attached to make it easier for everyone to use it.

Todo:
  • I need someone to make an executable version of it for Windows-Users
  • I'll make a GUI Version soon enough

Enjoy!

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: Axe Detokenizer
« Reply #1 on: June 26, 2011, 06:19:28 am »


I finished the GUI Version, I'll upload it later today.

Offline Runer112

  • Moderator
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2289
  • Rating: +639/-31
    • View Profile
Re: Axe Detokenizer
« Reply #2 on: June 26, 2011, 11:55:55 am »
It looks like you've got a bug on your hands. When a two-byte token is reached and parsed, the read pointer isn't advanced past both bytes, only the first byte. This results in every two-byte token being parsed as itself followed by the one-byte token represented by its second byte. To cite a few examples, I see Str2>Tok, DiagnosticOffSci, and Copy(nDeriv(.

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: Axe Detokenizer
« Reply #3 on: June 27, 2011, 06:44:40 am »
The bug reported by Runer112 (thanks a lot) has been fixed and attached is the version 1.1!

Added:
  • GUI Version (requires wxPython)

Fixed:
  • 2 Byte Tokens Bug

Offline XVicarious

  • LV6 Super Member (Next: 500)
  • ******
  • Posts: 485
  • Rating: +45/-28
  • I F**king Love Twisty Puzzles
    • View Profile
    • XVicarious
Re: Axe Detokenizer
« Reply #4 on: June 28, 2011, 05:07:07 pm »
So will it eventually be able to go from text to 8xp?

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: Axe Detokenizer
« Reply #5 on: July 05, 2011, 10:37:15 am »
So will it eventually be able to go from text to 8xp?

You mean tokenizing? I'm not sure if I could code that for now as it is quite hard I think.