32 Commits

Author SHA1 Message Date
无闻 2404f77725 Merge pull request #1 from phsmit/fix_gb18030
The correct iana name for GB18030 is without the dash
0
2015-01-15 18:35:09 +08:00
无闻 bdb5a064dd Merge pull request #2 from phsmit/8859_2-fix
Fix 8859_2 recognizers to use the appropriate newRecognizer function
2015-01-15 18:34:58 +08:00
无闻 c16067cf15 Merge pull request #3 from phsmit/new_readme
New readme
2015-01-15 18:34:54 +08:00
Peter Smit f71ee738d8 Fix doc link 2015-01-15 12:27:28 +02:00
Peter Smit 611ebac4ea Update Readme 2015-01-15 12:26:35 +02:00
Peter Smit ad5fc6db67 The correct iana name for GB18030 is without the dash
See http://www.iana.org/assignments/charset-reg/GB18030
2014-12-22 10:32:37 +02:00
Paul Bonser 8e251c7934 Fix 8859_2 recognizers to use the appropriate newRecognizer function 2013-12-17 19:09:55 -06:00
Sheng Yu 3af4cd4741 Add readme 2012-08-15 23:12:21 -07:00
Sheng Yu 4ced83d897 Add copyright and license files 2012-08-15 22:55:06 -07:00
Sheng Yu d5e8c406bf Delete old tests 2012-08-15 21:46:04 -07:00
Sheng Yu a27af3e8d9 Change detector_test to be something more real. Add a bunch of test pages. 2012-08-15 21:45:13 -07:00
Sheng Yu ff68a64285 Fix one more bug 2012-08-15 21:17:36 -07:00
Sheng Yu c462654c66 Bug fix 2012-08-15 20:42:35 -07:00
Sheng Yu ea51ccf612 Add documentation for public api 2012-08-15 17:44:11 -07:00
Sheng Yu cad71647b9 Move example test to it's own package 2012-08-15 17:42:58 -07:00
Sheng Yu 1e189a0f6c Add example test 2012-08-15 12:12:30 -07:00
Sheng Yu bbc42f160c Apply go fmt 2012-08-15 12:12:15 -07:00
Sheng Yu eb1e2b7f1a Finalize interface for detector 2012-08-15 11:46:09 -07:00
Sheng Yu ae559a90d6 Add ISO-2022 charset recognizers 2012-08-15 11:40:57 -07:00
Sheng Yu b1ae293603 Add detector_test and fix bugs found by it 2012-08-14 23:18:41 -07:00
Sheng Yu f39cc110e6 Add multi-byte charset detectors 2012-08-14 22:46:51 -07:00
Sheng Yu e19ac938c6 Unify the newRecognizer function naming convention 2012-08-14 15:31:14 -07:00
Sheng Yu 5c9192840e Add a bunch of single byte charset recognizers 2012-08-13 22:29:57 -07:00
Sheng Yu d14d4a2b5a Apply go fmt 2012-08-12 21:03:01 -07:00
Sheng Yu f180ac0ed6 Add utf-16/32 recognizers 2012-08-12 21:02:33 -07:00
Sheng Yu 6cd3d9e533 Revert "Move all files to ice directory so that I can add one for mozilla later"
This reverts commit 7487a3b0ec.
2012-08-12 20:09:50 -07:00
Sheng Yu 7487a3b0ec Move all files to ice directory so that I can add one for mozilla later 2012-08-12 17:51:13 -07:00
Sheng Yu 67b9aa7d57 Add test for utf8. Fix bugs found by the test. Apply go fmt 2012-08-12 17:08:29 -07:00
Sheng Yu 7bb0e42ca0 Add logic to sort and dedup recognizer outputs 2012-08-12 15:49:46 -07:00
Sheng Yu a3955fbed8 Add Utf8 recognizer 2012-08-12 15:22:11 -07:00
Sheng Yu 2381dc9431 Merge input and output to recognizer.go. Define interface of recognizer. 2012-08-12 11:37:04 -07:00
Sheng Yu e495a8d489 Define interface of chardet.Detector. Also implement the input processing logic. 2012-08-11 23:20:03 -07:00