Commit Graph
159 Commits
Author SHA1 Message Date
dhdfu 43dce6a52e Add a safe and effective read-line function, so we can dispose of huge
statically allocated buffers.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7727 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-02-02 21:32:44 +00:00
dhdfu bd46097a8a Add a handy in-place string stripping function
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7726 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-02-02 21:05:06 +00:00
dhdfu a15953851e Merge some improved comments
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7715 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-02-01 00:15:44 +00:00
dhdfu 46921f7f68 Make fe_process_frames() return the size of the output when called with NULL pointers
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7703 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-31 19:52:33 +00:00
nshmyrev 4983b68c7c Put variables in lowercase. Part of the
Hannu Kröger's patch.



git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7687 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-30 21:16:07 +00:00
dhdfu b44731e23f Implement fe_process_frames(), and implement fe_process_utt() using it.
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7665 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-29 00:34:24 +00:00
dhdfu 4553102230 More serious front-end surgery:
Make fe_process_utt() allocate a LOT less memory, and sanitize the
internal APIs a bit further.

Add a declaration for what will become the new recommended function
for processing cepstra.  It doesn't allocate any memory at all.

Remove other brain damage here and there.

The new code processes the last frame a bit differently.  I believe
that it's actually correct and the old code was wrong.  In any case
the difference is quite small.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7657 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-28 08:23:26 +00:00
dhdfu 03a8c7171c Continued deuglification
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7649 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-27 06:25:25 +00:00
dhdfu d1ed5c6f11 Begin to remove horrendous bogosity from the front-end code. First,
make the fe_t structure opaque, and remove the useless FB_TYPE parameter.

Also, don't allocate temporary buffers on every frame (!!!)

Finally, some minor updates to the Q15 code, which doesn't quite work
right still but will soon.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7644 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-26 23:42:59 +00:00
dhdfu 429c498784 add some basic definitions that used to be in "s2types.h"
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7640 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-25 21:09:33 +00:00
dhdfu f35ceb986a Make arg_t const
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7639 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-25 20:34:54 +00:00
dhdfu 46191b5c67 clarify the semantics of ngram_add_word on lmsets
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7633 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-25 01:03:38 +00:00
dhdfu f7b506a179 Add an option to preserve word ID mappings when adding/removing
language models (makes life sooo much easier for the decoder).


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7629 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-24 20:21:47 +00:00
dhdfu 4c1a132748 Add some things to the ngram_model API that are needed by
PocketSphinx, and enable it in libsphinxbase.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7623 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-24 06:52:57 +00:00
dhdfu 17e2c7ab61 Test lmctl file reading
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7607 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-19 23:26:39 +00:00
dhdfu 59814c8039 Most basic test of lmsets, can you select a model and score with it?
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7603 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-19 21:55:19 +00:00
dhdfu 922ffd686d Add important warnings here so that I don't forget them
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7601 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-19 21:34:40 +00:00
dhdfu eda4e582fb Implement language model control files, not tested yet.
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7600 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-19 21:03:35 +00:00
dhdfu 94dec2768c Explain what this actually does
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7598 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-18 21:09:19 +00:00
dhdfu f24594c5ed Fix the handling of OOVs and <UNK> to be more rational, and allow for
both closed and open vocabulary models (closed vocab still has tobe
tested)


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7597 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-18 21:04:18 +00:00
dhdfu 37a8a0b23f No need for this
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7596 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-18 07:10:50 +00:00
dhdfu 9e2b2d6046 Fill in a chunk of the implementation of ngram_model_set_t
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7595 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-18 05:58:20 +00:00
dhdfu b051700bd9 Skeleton of a language model set implementation and API.
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7587 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-17 05:54:01 +00:00
dhdfu 7ac6fe968f More optional output arguments
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7585 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-17 05:29:19 +00:00
dhdfu 35a1b97209 Make the output pointer optional
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7584 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-17 05:22:27 +00:00
dhdfu 7e63259d56 Add some convenience macros/functions for fetching int32 values
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7583 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-17 05:12:45 +00:00
dhdfu be93d6c2e3 Fix Win32 DLL issues with Sphinx3
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7571 94700074-3cef-4d97-a70e-9c8c206c02f5
2008-01-10 19:32:45 +00:00
dhdfu f173219a82 And, finally, an API for adding new classes to a language model.
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7494 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-18 05:03:31 +00:00
dhdfu 2a9775ea3c Make the function names more consistent, and also add an interface for
adding class words and interpolating language models.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7492 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-18 03:05:10 +00:00
dhdfu 8368c610c1 Add some subtle but useful behaviour to hash_table_replace()
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7487 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-17 17:32:34 +00:00
dhdfu 0c1df8eb52 XXXtreme test-first development dude. Add non-working (but compiling)
test case for class LMs, to be completed soon.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7485 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-17 15:25:54 +00:00
dhdfu fefa9d1ebe Internal and external API for class-based language models
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7483 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-17 15:08:32 +00:00
dhdfu 2041128e5d Correct some comments in the header
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7482 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-17 04:49:00 +00:00
dhdfu 0306d3ecff Support for adding words to a language model. It's not statistically correct...
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7481 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-17 04:36:07 +00:00
dhdfu 1f17fc18da * Make DMP models use less memory (discard non-useful mapid since we
have to read unigrams into memory anyway).
* Extend the language model APIs to include (non-stateful) backoff
  mode calculation.
* Store stuff we'd need to undo unigram weights (but not do that yet)


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7472 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-11 20:51:16 +00:00
dhdfu 7c786c655a Fill in more of the interface (including an intentional misspeling to
annoy future generations), and add a plan.

I'm not convinced that the "virtual function" implementation here is
actually going to be necessary, but it will make things easier for the
time being.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7462 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-04 13:59:30 +00:00
nshmyrev 73b439ee17 Include sphinx_config.h so users of ad_rec_t like
sphinx3_continuous will not confuse about size
of the structure



git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7457 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-12-01 19:21:15 +00:00
dhdfu c2ea4fa98b Fill in some stubs for various language model file formats
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7449 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-29 19:00:21 +00:00
dhdfu d4ae934743 Add thread safety stuff to linklist.h functions. Because Win32 is
stupid this requires some extra caution.  And it might have broken
Windows compilation, which I will fix later today.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7431 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-28 14:01:38 +00:00
dhdfu 1cb0c7e87e fix make distcheck for the third time
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7419 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-22 12:56:12 +00:00
dhdfu 2214e6617e Update the ngram_model API a bit and start giving substance to the implementation.
Actually going to base this on the PocketSphinx version rather than
the Sphinx3 version, because the Sphinx3 is overengineered.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7410 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-18 17:00:35 +00:00
dhdfu 99e22986cf Because I am totally XTREME, dude, I am engaging in test-first development. Here are some tests for the unimplemented SphinxBase language model API
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7409 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-18 15:43:16 +00:00
dhdfu edd0b380ec Officially support setting command line values
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7408 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-18 15:41:29 +00:00
dhdfu a9271d2488 Use angle brackets
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7407 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-18 15:41:01 +00:00
dhdfu 2f6616564d Add extern "C" declarations for C++ (patch from Krisztian Loki)
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7387 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-13 22:22:29 +00:00
tkharris 93525fe32f Export mmio functions when building Windows DLL (these functions required by libpocketsphinx at least).
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7379 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-06 03:46:47 +00:00
dhdfu 023c97800b This inlining is kind of ugly and isn't really necessary anymore (plus the function is rather large)
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7371 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-02 04:03:30 +00:00
dhdfu a344bde5f5 Get "zero" correct, and add a highly useful feature where log tables
are never smaller than 256 elements.  This seems totally arbitrary but
is necessary to do fast addition of quantized log probabilities.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7368 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-01 22:41:07 +00:00
dhdfu 401d1af9de Handle overflows more gracefully
git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7363 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-01 15:05:47 +00:00
dhdfu e3b92302d0 Revert the meaning of shift, and add the option to not use an add
table.  This is all still up in the air and requires some serious
experimentation to figure out what is fastest.


git-svn-id: svn+ssh://svn.code.sf.net/p/cmusphinx/code/trunk/sphinxbase@7359 94700074-3cef-4d97-a70e-9c8c206c02f5
2007-11-01 12:47:36 +00:00