next_token

next_token()

Instance Public methods

The method to fetch next token. If you use do_parse method, you must implement next_token.

The format of return value is [TOKEN_SYMBOL, VALUE]. token-symbol is represented by Ruby's symbol by default, e.g. :IDENT for 'IDENT'. â;â (String) for ';'.

The final symbol (End of file) must be false.

Links:

https://github.com/ruby/ruby/blob/dfb30ef5357d7518a7badd7b67984f1287f094e3/lib/racc/parser.rb#L269

doc_ruby_on_rails

2015-04-29 22:51:26

Comments

Popular Articles

next_token next_token() Instance Public methods Returns the next token from the inline text

tokenize.tokenize() tokenize.tokenize(readline) The tokenize() generator requires one argument, readline, which must be a callable object which provides the same inte

token_dom_tokens token_dom_tokens(first, last=None) Instance Public methods Alias for: token_DOM

token token() Instance Public methods

tokenize tokenize(ruby, options) Class Public methods Returns an Array of ruby tokens. See ::new for a description of options.