Type:
Module

A TokenStream is a list of tokens, gathered during the parse of some entity (say a method). Entities populate these streams by being registered with the lexer. Any class can collect tokens by including TokenStream. From the outside, you use such an object by calling the #start_collecting_tokens method, followed by calls to #add_token and pop_token.

add_token
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

add_token(*tokens) Instance Public methods Alias for:

2025-01-10 15:47:30
collect_tokens
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

collect_tokens() Instance Public methods Starts collecting tokens

2025-01-10 15:47:30
pop_token
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

pop_token() Instance Public methods Remove the last token from the collected

2025-01-10 15:47:30
to_html
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

to_html(token_stream) Class Public methods Converts token_stream

2025-01-10 15:47:30
add_tokens
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

add_tokens(*tokens) Instance Public methods Adds tokens to the

2025-01-10 15:47:30
tokens_to_s
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

tokens_to_s() Instance Public methods Returns a string representation of the

2025-01-10 15:47:30
start_collecting_tokens
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

start_collecting_tokens() Instance Public methods Alias for:

2025-01-10 15:47:30
token_stream
  • References/Ruby on Rails/Ruby/Classes/RDoc/RDoc::TokenStream

token_stream() Instance Public methods Current token stream

2025-01-10 15:47:30