## Class CFW_Util_Tokenizer

Description

トークン切り出しクラス

- author: okada

Located in /Util/Tokenizer.php (line 7)

Class Constant Summary
EOF = false
Variable Summary
unknown_type $c
unknown_type $delimiter
unknown_type $ignore
unknown_type $operator
unknown_type $quotes
unknown_type $reader
unknown_type $token
Method Summary
unknown_type __construct (CFW_IO_Reader $reader, [$option $option = array()])
bool hasMoreTokens ()
unknown_type isDelimiter ($c $c)
unknown_type isIgnoreChar ($c $c)
unknown_type isOperator ($c $c)
unknown_type isQuote ($c $c)
unknown_type nextToken ()
Variables
unknown_type $c (line 18)

最後に読み込んだ文字

unknown_type $delimiter = array(" ","\t", "\r\n") (line 37)

区切り文字定義

デフォルトは空白、タブ、改行

unknown_type $ignore = array(" ","\t", "\r\n") (line 30)

無視する文字の定義

デフォルトは 空白、タブ、改行

unknown_type $operator = array("(",")","+","*","-","/") (line 42)

演算子定義

unknown_type $quotes = array("\"","'") (line 47)

引用記号定義

unknown_type $reader (line 13)

読み取り装置

unknown_type $token (line 23)

最後のトークン

Methods
Constructor __construct (line 56)

構築

- access: public

unknown_type __construct (CFW_IO_Reader $reader, [$option $option = array()])

- CFW_IO_Reader $reader: 読み取りクラス
- $option $option: オプション ignore,delimiter,operator,quote

hasMoreTokens (line 79)

まだトークンが残っているかチェック

- access: public

bool hasMoreTokens ()
isDelimiter (line 199)

指定文字が区切文字化チェック

unknown_type isDelimiter ($c $c)

- $c $c

isIgnoreChar (line 188)

指定文字が無視されるべきがチェック

unknown_type isIgnoreChar ($c $c)

- $c $c

isOperator (line 210)

指定文字が演算子かチェック

unknown_type isOperator ($c $c)

- $c $c

isQuote (line 221)

指定文字が引用記号かチェック

unknown_type isQuote ($c $c)

- $c $c

nextToken (line 90)

次のトークンを取得

- access: public

unknown_type nextToken ()
Class Constants
EOF = false (line 8)

Documentation generated on Fri, 25 Dec 2009 21:43:20 +0900 by phpDocumentor 1.4.3