SphinxBase 5prealpha
|
Common implementation of ngram_model_t. More...
#include <ngram_model_internal.h>
Data Fields | |
int | refcount |
Reference count. | |
uint32 * | n_counts |
Counts for 1, 2, 3, ... grams. | |
int32 | n_1g_alloc |
Number of allocated word strings (for new word addition) | |
int32 | n_words |
Number of actual word strings (NOT the same as the number of unigrams, due to class words). | |
uint8 | n |
This is an n-gram model (1, 2, 3, ...). | |
uint8 | n_classes |
Number of classes (maximum 128) | |
uint8 | writable |
Are word strings writable? | |
uint8 | flags |
Any other flags we might care about (FIXME: Merge this and writable) | |
logmath_t * | lmath |
Log-math object. | |
float32 | lw |
Language model scaling factor. | |
int32 | log_wip |
Log of word insertion penalty. | |
int32 | log_zero |
Zero probability, cached here for quick lookup. | |
char ** | word_str |
Unigram names. | |
hash_table_t * | wid |
Mapping of unigram names to word IDs. | |
int32 * | tmp_wids |
Temporary array of word IDs for ngram_model_get_ngram() | |
struct ngram_class_s ** | classes |
Word class definitions. | |
struct ngram_funcs_s * | funcs |
Implementation-specific methods. | |
Common implementation of ngram_model_t.
The details of bigram, trigram, and higher-order N-gram storage, if any, can vary somewhat depending on the file format in use.
Definition at line 55 of file ngram_model_internal.h.
struct ngram_class_s** ngram_model_s::classes |
Word class definitions.
Definition at line 74 of file ngram_model_internal.h.
Referenced by ngram_model_add_class(), ngram_model_add_class_word(), ngram_model_free(), ngram_ng_prob(), and ngram_ng_score().
uint8 ngram_model_s::flags |
Any other flags we might care about (FIXME: Merge this and writable)
Definition at line 65 of file ngram_model_internal.h.
struct ngram_funcs_s* ngram_model_s::funcs |
Implementation-specific methods.
Definition at line 75 of file ngram_model_internal.h.
Referenced by ngram_model_add_word(), ngram_model_apply_weights(), ngram_model_flush(), ngram_model_free(), ngram_ng_prob(), and ngram_ng_score().
logmath_t* ngram_model_s::lmath |
Log-math object.
Definition at line 67 of file ngram_model_internal.h.
Referenced by ngram_model_add_class_word(), ngram_model_add_word(), ngram_model_set_add(), ngram_model_set_init(), ngram_model_set_interp(), and ngram_model_set_remove().
int32 ngram_model_s::log_wip |
Log of word insertion penalty.
Definition at line 69 of file ngram_model_internal.h.
Referenced by ngram_model_get_weights(), and ngram_score_to_prob().
int32 ngram_model_s::log_zero |
Zero probability, cached here for quick lookup.
Definition at line 70 of file ngram_model_internal.h.
Referenced by ngram_model_add_word(), ngram_model_set_remove(), ngram_ng_prob(), ngram_ng_score(), and ngram_zero().
float32 ngram_model_s::lw |
Language model scaling factor.
Definition at line 68 of file ngram_model_internal.h.
Referenced by ngram_model_get_weights(), and ngram_score_to_prob().
uint8 ngram_model_s::n |
This is an n-gram model (1, 2, 3, ...).
Definition at line 62 of file ngram_model_internal.h.
Referenced by ngram_model_get_size(), ngram_model_set_add(), ngram_model_set_init(), and ngram_model_set_remove().
int32 ngram_model_s::n_1g_alloc |
Number of allocated word strings (for new word addition)
Definition at line 58 of file ngram_model_internal.h.
Referenced by ngram_model_set_map_words().
uint8 ngram_model_s::n_classes |
Number of classes (maximum 128)
Definition at line 63 of file ngram_model_internal.h.
Referenced by ngram_model_add_class(), ngram_model_add_class_word(), and ngram_model_free().
uint32* ngram_model_s::n_counts |
Counts for 1, 2, 3, ... grams.
Definition at line 57 of file ngram_model_internal.h.
Referenced by ngram_model_free(), and ngram_model_get_counts().
int32 ngram_model_s::n_words |
Number of actual word strings (NOT the same as the number of unigrams, due to class words).
Definition at line 59 of file ngram_model_internal.h.
Referenced by ngram_model_casefold(), ngram_model_free(), ngram_model_set_add(), ngram_model_set_current_wid(), ngram_model_set_known_wid(), ngram_model_set_map_words(), ngram_model_set_remove(), and ngram_word().
int ngram_model_s::refcount |
Reference count.
Definition at line 56 of file ngram_model_internal.h.
Referenced by ngram_model_free(), and ngram_model_retain().
int32* ngram_model_s::tmp_wids |
Temporary array of word IDs for ngram_model_get_ngram()
Definition at line 73 of file ngram_model_internal.h.
hash_table_t* ngram_model_s::wid |
Mapping of unigram names to word IDs.
Definition at line 72 of file ngram_model_internal.h.
Referenced by ngram_model_casefold(), ngram_model_free(), ngram_model_set_map_words(), ngram_unknown_wid(), and ngram_wid().
char** ngram_model_s::word_str |
Unigram names.
Definition at line 71 of file ngram_model_internal.h.
Referenced by ngram_model_casefold(), ngram_model_free(), ngram_model_set_add(), ngram_model_set_map_words(), and ngram_word().
uint8 ngram_model_s::writable |
Are word strings writable?
Definition at line 64 of file ngram_model_internal.h.
Referenced by ngram_model_add_word(), ngram_model_casefold(), ngram_model_free(), and ngram_model_set_map_words().