wfl::tokenizer Namespace Reference

Classes
struct	token
struct	token_error

Typedefs
typedef std::string::const_iterator	iterator

Enumerations
enum class	token_type {   operator_token , string_literal , identifier , integer ,   decimal , lparens , rparens , lsquare ,   rsquare , comma , semicolon , whitespace ,   eol , keyword , comment , pointer }

Functions
token	get_token (iterator &i1, const iterator i2)

Typedef Documentation

iterator

typedef std::string::const_iterator wfl::tokenizer::iterator

Definition at line 25 of file tokenizer.hpp.

Enumeration Type Documentation

token_type

enum wfl::tokenizer::token_type

strong

Enumerator
operator_token
string_literal
identifier
integer
decimal
lparens
rparens
lsquare
rsquare
comma
semicolon
whitespace
eol
keyword
comment
pointer

Definition at line 27 of file tokenizer.hpp.

Function Documentation

get_token()

token wfl::tokenizer::get_token	(	iterator &	i1,
		const iterator	i2
	)

Definition at line 44 of file tokenizer.cpp.

References comma, comment, decimal, eol, identifier, integer, keyword, lparens, lsquare, operator_token, pointer, rparens, rsquare, s, semicolon, string_literal, t, and whitespace.

Referenced by BOOST_AUTO_TEST_CASE(), and wfl::formula::formula().