« previous next »
Pages: 1 ... 8 9 [10] 11 12 ... 24   Go Down

Author Topic: TokenIDE - TI-BASIC IDE  (Read 85419 times)

0 Members and 1 Guest are viewing this topic.

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #135 on: December 05, 2010, 12:25:46 pm »
These are all things I plan on putting in, but I'm glad that other people would find them useful as well. It will be project-based, so Ctrl-S will save the file as plain text, and F5 will "build" it. I'm hesitant to call this a compiler, though, as it's not really compiling anything. It's simply tokenizing the input, which isn't quite the same.
Logged
Shaun

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: Tokens
« Reply #136 on: December 05, 2010, 12:42:12 pm »
Quote from: merthsoft on December 05, 2010, 12:25:46 pm
These are all things I plan on putting in, but I'm glad that other people would find them useful as well. It will be project-based, so Ctrl-S will save the file as plain text, and F5 will "build" it. I'm hesitant to call this a compiler, though, as it's not really compiling anything. It's simply tokenizing the input, which isn't quite the same.

I believe that tokenizing and storying the bytes in .8xp is compiling, though.

I use tokens all the time, it's fantastic:

What I noticed:

!=  stands for inequal sign

->  stands for STO Sign

This is great!
Logged

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #137 on: December 05, 2010, 12:45:36 pm »
It's not, though. It can be one part of compiling, but it's not really compiling itself. Compilation is the process of turning one computer language into another, and this isn't doing that. It's taking one computer language, and turning it into its tokenized form.
Logged
Shaun

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: Tokens
« Reply #138 on: December 05, 2010, 03:08:26 pm »
Quote from: merthsoft on December 05, 2010, 12:45:36 pm
It's not, though. It can be one part of compiling, but it's not really compiling itself. Compilation is the process of turning one computer language into another, and this isn't doing that. It's taking one computer language, and turning it into its tokenized form.

You are the professional here, so I'll look up to your ideas xD

Logged

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: Tokens
« Reply #139 on: December 05, 2010, 08:55:21 pm »
Quote from: ScoutDavid on December 05, 2010, 12:42:12 pm
Quote from: merthsoft on December 05, 2010, 12:25:46 pm
These are all things I plan on putting in, but I'm glad that other people would find them useful as well. It will be project-based, so Ctrl-S will save the file as plain text, and F5 will "build" it. I'm hesitant to call this a compiler, though, as it's not really compiling anything. It's simply tokenizing the input, which isn't quite the same.

I believe that tokenizing and storying the bytes in .8xp is compiling, though.

I use tokens all the time, it's fantastic:

What I noticed:

!=  stands for inequal sign

->  stands for STO Sign

This is great!

Does it means ! and = and - and > will compile to the not equal and sto symbols? Not that this would be a problem in code syntax, but if someone uses an ASCII tilemap containing these characters one after each others, could it lead to problems?
Logged

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #140 on: December 05, 2010, 08:58:53 pm »
If you have "!=" it will turn in to the not equals sign. However, if you do "!\=", it will convert it to the two separate symbols.
Logged
Shaun

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8217
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Tokens
« Reply #141 on: December 05, 2010, 10:54:20 pm »
Quote from: merthsoft on December 05, 2010, 08:58:53 pm
If you have "!=" it will turn in to the not equals sign. However, if you do "!\=", it will convert it to the two separate symbols.

Nice, so I can put \ in between any characters and it'll parse them separately?
Logged



Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: Tokens
« Reply #142 on: December 06, 2010, 01:25:30 am »
I see, sounds good then. :)
Logged

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #143 on: December 06, 2010, 11:18:08 am »
Quote from: Deep Thought on December 05, 2010, 10:54:20 pm
Quote from: merthsoft on December 05, 2010, 08:58:53 pm
If you have "!=" it will turn in to the not equals sign. However, if you do "!\=", it will convert it to the two separate symbols.

Nice, so I can put \ in between any characters and it'll parse them separately?
Yup! The "\" character is basically the "parse this next character as a single character" flag (or maybe it's "stop parsing this word at this charcter? I forget, I think the latter is more useful, though, so if it's not that now it will be soon).
Logged
Shaun

Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: Tokens
« Reply #144 on: December 06, 2010, 01:05:42 pm »
What if someone wants to type a massive RPG NPC convo in Tokens, though? ??? That must take INSANE amount of work if you have to put backslashes between every character to prevent them from being converted to actual commands! O.O
« Last Edit: December 06, 2010, 01:06:10 pm by DJ Omnimaga »
Logged

Offline merthsoft

  • LV5 Advanced (Next: 300)
  • *****
  • Posts: 241
  • Rating: +63/-1
    • View Profile
Re: Tokens
« Reply #145 on: December 06, 2010, 01:29:15 pm »
Only the ones that are converted in to commands that you don't want to be tokenized. It actually helps, in some cases, because it'll save space. For instance, if the dialog is:
"Hello, friend, what would you like to buy today?"
Those will all be separate letters, because none of those are commands. However, if you have:
"Input your name:"
The "Input " will be tokenized, which would save you 9 bytes if you wanted to keep it that way. If you didn't, you'd simply put:
"Inpu\t your name:"
Logged
Shaun

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8217
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Tokens
« Reply #146 on: December 06, 2010, 02:14:49 pm »
Oh, and another request, having the hex box in a monospaced font.
Logged



Offline DJ Omnimaga

  • Clacualters are teh gr33t
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55943
  • Rating: +3154/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • Dream of Omnimaga Music
Re: Tokens
« Reply #147 on: December 06, 2010, 02:15:12 pm »
Oh right, I guess that can work. Thanks for the tip :D
Logged

Offline Munchor

  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6199
  • Rating: +295/-121
  • Code Recycler
    • View Profile
Re: Tokens
« Reply #148 on: December 07, 2010, 03:51:33 pm »
Quote from: merthsoft on December 06, 2010, 01:29:15 pm
Only the ones that are converted in to commands that you don't want to be tokenized. It actually helps, in some cases, because it'll save space. For instance, if the dialog is:
"Hello, friend, what would you like to buy today?"
Those will all be separate letters, because none of those are commands. However, if you have:
"Input your name:"
The "Input " will be tokenized, which would save you 9 bytes if you wanted to keep it that way. If you didn't, you'd simply put:
"Inpu\t your name:"

I saw your Tokens.xml and found out about all the alternative strings to be converted. :) (like -> and the real ->)
Logged

Offline Eeems

  • Mr. Dictator
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 6268
  • Rating: +318/-36
  • little oof
    • View Profile
    • Eeems
Re: Tokens
« Reply #149 on: December 11, 2010, 08:23:52 pm »
MOAR GUI EDITOR NEEDED!
Quote
[18:22]   <Merth>   So how about you go to the topic and yell at me to work on the DCS GUI editor ;)
[18:22]   <Eeems>   lol ok :P
Logged
/e
Pages: 1 ... 8 9 [10] 11 12 ... 24   Go Up
« previous next »