Author Topic: TokenIDE - TI-BASIC IDE  (Read 83050 times)

0 Members and 1 Guest are viewing this topic.

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #90 on: November 02, 2010, 04:46:53 pm »
Well, the comments are ignored by the program, so specifying them in there won't help it at all. You should still upload that, it would be useful for me to see what people are adding and all that.

Deep Thought: There will be a chooser so you can pick things out.
Shaun

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8217
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Tokens
« Reply #91 on: November 02, 2010, 04:52:10 pm »
Deep Thought: There will be a chooser so you can pick things out.

Oh, sounds good, then.




Offline Runer112

  • Moderator
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2289
  • Rating: +639/-31
    • View Profile
Re: Tokens
« Reply #92 on: November 02, 2010, 05:25:25 pm »
Ok, here's the modified xml file. Changes include:
  • Incorrect tokens/tokens with typographical errors fixed
  • Duplicate/erroneous tokens removed
  • Missing tokens added
  • Ensured that all token strings could be typed on a standard American English keyboard (¿ and ¡ could not)
  • All non-pretty statistics functions and lowercase statistics variables (all two-byte tokens starting with $62 except F) standardized to [x] format
  • All single-letter special tokens (e.g. ˪, i, F, ᴇ) standardized to /x format
  • All raised symbols standardized to ^^x format (not only does this seem more logical than **x to me, but also ** is an Axe Parser command that could be misinterpreted)
  • Some other minor changes I'm probably forgetting about
  • "Pretty" alternate strings added
  • Axe Parser alternate strings added


Primary strings can all be typed on a keyboard. Alternate strings are sorted in the following manner:

Alternates that can be typed on a keyboard are first. "Pretty" alternates appear next. "Alternates" is plural because tokens that have more than one "pretty-ifiable" characters (e.g. chi^2cdf() are broken down into all possible pretty/non-pretty combinations (e.g. χ^2cdf(, chi²cdf(, and χ²cdf(). These are sorted in increasing order of "prettiness." Following any "Pretty" alternates come Axe Parser alternates, sorted according to the preceding rules.
« Last Edit: November 02, 2010, 06:17:23 pm by Runer112 »

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #93 on: November 02, 2010, 06:00:08 pm »
Wow, that's awesome. Thanks so much, Runner. The Axe commands I'll end up taking out into a separate Axe.xml file, but for now this is perfect. There are some things I'll change, and I'll have to look over it a little more in depth, but this is awesome. Out of curiosity, what were the duplicate tokens, and what were the missing ones?
Shaun

Offline Runer112

  • Moderator
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2289
  • Rating: +639/-31
    • View Profile
Re: Tokens
« Reply #94 on: November 02, 2010, 06:10:31 pm »
Wow, that's awesome. Thanks so much, Runner. The Axe commands I'll end up taking out into a separate Axe.xml file, but for now this is perfect. There are some things I'll change, and I'll have to look over it a little more in depth, but this is awesome. Out of curiosity, what were the duplicate tokens, and what were the missing ones?

$6338-$633F and $7E00-$7E07 were the only duplicates I think ($7E00-$7E07 were the correct ones). You missed $6237-$623C, $BBED-$BBF5, and I think few scattered others.

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #95 on: November 02, 2010, 06:47:28 pm »
Ok, great. Thanks. I did make some changes. Instead of using backslash as the standard, it's now the pipe character, "|". This is because backslash already has a meaning, and I don't want that ambiguity to exists. Basically, the blackslash tells the tokenizer to tokenize the next character as a single character. That way you can differentiate from, say, the max( token and the string "max(" by doing "\max(" to make it the string of four characters. Other than that it looks great :). I'll keep looking over it.

Question: Why do some of the Axe commands end with "{", like nib?
« Last Edit: November 02, 2010, 06:57:58 pm by merthsoft »
Shaun

Offline Runer112

  • Moderator
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2289
  • Rating: +639/-31
    • View Profile
Re: Tokens
« Reply #96 on: November 02, 2010, 07:22:43 pm »
To read and write to pointers in Axe, you have to enclose the pointer value in curly brackets. I believe Quigibo uses curly brackets on some of his commands, like nib{, because they take only one argument, and that argument is a pointer.

By the way, the Celtic III section seems to be malfunctioning. I accidentally stumbled into this when loading an Axe source file, because Axe uses the command det( followed by a number to allocate data sections in the compiled program. I believe all the Celtic III commands are in the format of det(number,stuff) whereas Axe uses the command in the format of det(number). Even though there is no comma after the first digit in det( calls in the Axe source file, it seems that it is being somehow intercepted by the Celtic III commands. However, because there is no comma, it doesn't actually match a token, and all it ends up doing is deleting the det( token and the first digit following it.

EDIT: It appears that this error also applies to other shell extension commands in the xml file.
« Last Edit: November 02, 2010, 07:28:36 pm by Runer112 »

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #97 on: November 02, 2010, 07:50:47 pm »
Hmm. That's strange. It could be having issues when there's an alt and some more tokens under it. I removed all the axe tokens in mine, actually, and made a separate Axe.xml file (since BASIC with ASM libs and AXE are two separate things). I have a new version up, by the way:
http://myserverathome.com/Tokens.zip

Some things that I remember since the last update are:
An about box, using the logo designed by Weregoose!
The preview window and all that jazz for the crop image:

Any other bug fixes I've made.
New tokens files. Tokens2.xml is what it now defaults to. Tokens1.xml is kept since it's what was used before, in case something doesn't looks quite right. Axe.xml has some of the Axe commands.

I got a little lazy with committing to git, so I kind of forget what I've done :( But please, use this newer version.
Shaun

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: Tokens
« Reply #98 on: November 02, 2010, 08:03:43 pm »
Nice, I like how we can create pics from cropped images. It seems to convert pretty well too :)

Offline Runer112

  • Moderator
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2289
  • Rating: +639/-31
    • View Profile
Re: Tokens
« Reply #99 on: November 02, 2010, 08:29:00 pm »
By the way, you might want to consider messing around with the main text box properties a bit :P

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #100 on: November 02, 2010, 08:31:47 pm »
O_o
What did you do to make that happen?
Shaun

Offline Runer112

  • Moderator
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2289
  • Rating: +639/-31
    • View Profile
Re: Tokens
« Reply #101 on: November 02, 2010, 08:36:21 pm »
O_o
What did you do to make that happen?

Copy and paste? Lol

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: Tokens
« Reply #102 on: November 02, 2010, 08:50:14 pm »
Wait you can paste file icons in there? ???

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #103 on: November 02, 2010, 09:12:49 pm »
Ahahaha. weird...
Shaun

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8217
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Tokens
« Reply #104 on: November 03, 2010, 08:00:43 pm »
And it's a ... space? :D

I'm starting to use this for some projects. It's really nice.
« Last Edit: November 03, 2010, 08:00:53 pm by Deep Thought »