基于詞典的中文分詞歧義算法研究

1、東北師范大學碩士學位論文基于詞典的中文分詞歧義算法研究姓名：劉延吉申請學位級別：碩士專業(yè)：計算機應用技術指導教師：孫鐵利20090501AbstractW砧therapidpopularizationofcomputernetworks，thepeople出eadyenteredtheinformationageIntheinformationsociety，theimportanceofinformationisincreasingT

2、henagreatdealofusefulinformationwouldbeacquiredandmasteredwhoeverindividuals，businessesandeventheGovernmentInthiscireurnstance，ChineseinformationprocessingtechnologyhasgraduallybecomehotspotsfordevelopmenttechnologyOneof

3、themostimportanttechnologysofChineseinformationprocessingtechnologyisChinesewordsegmentationChinesewordsegmentationtechnologymeansaprocesswhichusingthecorrespondingwordsegmentationalgorithmtoseparatethetextandeasilytodea

4、lwi也andunderstandtheinformationbycomputerItsrangeofapplicationsis謝de，mainlyusedininformationretrieval，informationextractionmachinetranslation，naRll同languageprocessingtechnologyandSOonAtthesametime，itincludesmanyaspects，s

5、uchasChinesewordsegmentationalgorithm，unknownwordrecognitiontechnology，ambiguouswordprocessingtechnology，andSOonAmbiguousprocessingtechnologyandBnkllownwordrecognitiontechnologyistwodifficultiesofChinesewordsegmentationt

6、echnologyInthispaper，itwillmainlystudythewordsegmentationalgorithmandambiguityprocessingtechniquesofChinesewordsegmentationFirstly，hathispaperitusedatypicalChinesewordsegmentationalgorithmbasedondictionarytheLargestForwa

7、rdMatchingAlgorithmnleideaofitissimpleandeasytoimplement，buttheresultofthesegmentationaceuracyandthesegmentationspeedseemstobenotidealFortheprobleminthispaperitUSeSthedoublehashstructuredictionarymechanismforimprovingthe

8、speedofwordsegmentationaswellasinthispaperproposedanimprovedLargestForwardMatchingAlgorithmforimprovingtheaccuracyofsegmentationSecondly，ambiguityprocessingtechnologyisodeoftheimportantcomponentsofChinesewordsegmentation

9、technologyOnlydeal、航mtheambiguityfieldcompletelyitwouldsegmentthetextcorrectlyTherefore，ituseadisambiguationalgorithmcombine塒thprobabilityandrulesbehindproposedtheimprovedLargestForwardMattingAlgorithminordertoachievebet

10、tersegmentationresultsFinally，weconcernthesystemperformancemeasurementmetrics，suchasprecisionspeed，realizableandSOonThenadesignoftheChineseWordSegmentationSystemisgivenandtheChineseWordSegmentationSystemisachievedAtthesa