fjt:UdZddlmZddlZddlmZddlmZddlm Z ide dd hd e d d hd e d hde dhde dhde ddhde ddhde dhde dhde dhde dhde dhde hd d!e d"d#hd$e d%hd&e d hd'e d(he d)he d*he d+he d,he d-he d.he d/d0he d1he d1he d2d3he d4he d4hd5 Z d6e d7<d dd d(d)d*d+d,d-d d.d d8 Z d9e d:<dd?Zdd@ZeZidddAdBdCdDddEdddFdddGdHdId"ddJdKdLd&dMdNdOdPdQdRdSdTdUdVdWdXidYdZd[d\dd]d^d d1d_d4d`dadbd)dcd ddd+ded-dfd,dgdhdidjdkdldmdndodpdqZd9e dr<ddsZdtZdue dv<dwZdue dx<dyfdd}ZeeZd6e d~<ddZiZd6e d<e D]K\ZZe epeZe deDZeee ezee<LeedZd6e d<ddZ ddZ!e ddhZ"de d<ddZ#ddZ$dS)a$Encoding equivalences and name remapping. This module defines: 1. **Directional supersets** for accuracy evaluation: detecting a superset encoding when the expected encoding is a subset is correct (e.g., detecting UTF-8 when expected is ASCII), but not the reverse. 2. **Bidirectional equivalents**: groups of encodings where detecting any member when another member was expected is considered correct. This includes UTF-16/UTF-32 endian variants (which encode the same text with different byte order) and ISO-2022-JP branch variants (which are compatible extensions of the same base encoding). 3. **Preferred superset mapping** for the ``prefer_superset`` API option: replaces detected ISO/subset encoding names with their Windows/CP superset equivalents that modern software actually uses. 4. **Compatibility names** for the default ``compat_names=True`` mode: maps internal Python codec names to the names chardet 5.x/6.x returned, preserving backward compatibility for callers that compare encoding strings directly. ) annotationsN)Callable) DetectionDictlookup_encodingASCIIzutf-8cp1252zTIS-620 iso8859-11cp874z ISO-8859-11GB2312gb18030GBKBig5 big5hkscscp950 Shift_JIScp932shift_jis_2004zShift-JISX0213zEUC-JP euc_jis_2004z EUC-JISX0213zEUC-KRcp949CP037cp1140z ISO-2022-JP> iso2022_jp_2iso2022_jp_extiso2022_jp_2004z ISO2022-JP-1rrz ISO2022-JP-3rz ISO-8859-1z ISO-8859-2cp1250cp1251cp1256cp1253cp1255cp1254cp1257z utf-16-lez utf-16-bezutf-16z utf-32-lez utf-32-bezutf-32) ISO-8859-5z ISO-8859-6 ISO-8859-7 ISO-8859-8 ISO-8859-9z ISO-8859-13UTF-16z UTF-16-LEz UTF-16-BEUTF-32z UTF-32-LEz UTF-32-BEdict[str, frozenset[str]] SUPERSETS) asciieuc_kr iso8859-1z iso8859-2 iso8859-5z iso8859-6 iso8859-7 iso8859-8 iso8859-9r z iso8859-13tis-620dict[str, str]PREFERRED_SUPERSETresultrmappingreturnc|d}t|tr||||d<|S)zGReplace the encoding name using *mapping*, modifying *result* in-place.encoding)get isinstancestr)r5r6encs hC:\Users\Terasoftware\OneDrive\Desktop\faahhh\fyndo\fyndo\venv\Lib\site-packages\chardet/equivalences.py_remap_encodingr?lsB **Z C#s3$[[c22z Mc,t|tS)a7Replace the encoding name with its preferred Windows/CP superset. Modifies the ``"encoding"`` value in *result* in-place and returns *result* for fluent chaining. :param result: A detection result dict containing an ``"encoding"`` key. :returns: The same *result* dict, modified in-place. )r?r4r5s r>apply_preferred_supersetrCts 6#5 6 66r@cp855IBM855cp866IBM866CP949r,GB18030hzz HZ-GB-2312 iso2022_krz ISO-2022-KRr-r.r#r/r$r0r%r1r&johabJohabzkoi8-rzKOI8-Rz mac-cyrillic MacCyrillicz mac-romanMacRoman SHIFT_JISr2r'r(z utf-8-sigz UTF-8-SIGz Windows-1251z Windows-1252z Windows-1253z Windows-1254z Windows-1255kz1048KZ1048z mac-greekMacGreekz mac-iceland MacIcelandz mac-latin2 MacLatin2z mac-turkish MacTurkish _COMPAT_NAMESc,t|tS)a7Convert internal codec names to chardet 5.x/6.x compatible names. Modifies the ``"encoding"`` value in *result* in-place and returns *result* for fluent chaining. :param result: A detection result dict containing an ``"encoding"`` key. :returns: The same *result* dict, modified in-place. )r?rWrBs r>apply_compat_namesrYs 6= 1 11r@))rrrtuple[tuple[str, ...], ...]BIDIRECTIONAL_GROUPS))skcs)ukrubgbe)msid)nodasvLANGUAGE_EQUIVALENCESc|SN)xs r>rlsr@groups normalizeCallable[[str], str]cri}|D]0}tfd|D}|D]}|||<1|S)zJBuild a lookup: key -> frozenset of all equivalent keys in the same group.c3.K|]}|VdSrirj).0nrns r> z%_build_group_index..s+77A99Q<<777777r@) frozenset)rmrnr5groupnormednames ` r>_build_group_indexrysi )+F--777777777 - -D&,F99T?? # # - Mr@_LANGUAGE_EQUIVexpectedr<detectedboolcV||krdSt|}|duo||vS)aCheck whether *detected* is an acceptable language for *expected*. Returns ``True`` when *expected* and *detected* are the same ISO 639-1 code, or belong to the same equivalence group in :data:`LANGUAGE_EQUIVALENCES`. :param expected: Expected ISO 639-1 language code. :param detected: Detected ISO 639-1 language code. :returns: ``True`` if the languages are equivalent. TN)rzr:)r{r|rvs r>is_language_equivalentrs>8t    ) )E   2U!22r@_NORMALIZED_SUPERSETSc#8K|]}t|p|VdSrir)rrss r>rtrt s/DDA**/aDDDDDDr@c$t|p|Srir)rss r>rlrlsoa.@.@.EAr@)rn_NORMALIZED_BIDIR str | Nonec||duS|dSt|p|}t|p|}||krdS|tvr|t|vrdS|tvo|t|vS)aCheck whether *detected* is an acceptable answer for *expected*. Acceptable means: 1. Exact match (after normalization), OR 2. Both belong to the same bidirectional byte-order group, OR 3. *detected* is a known superset of *expected*. :param expected: The expected encoding name, or ``None`` for binary files. :param detected: The detected encoding name, or ``None``. :returns: ``True`` if the detection is acceptable. NFT)rlowerrr)r{r|norm_expnorm_dets r> is_correctrs 4ux((rtz#_strip_combining..8s2CC+*?*B*BC1CCCCCCr@)rrnjoin)rnfkds r>_strip_combiningr5s5   . .D 77CCdCCC C CCr@)¤€)rrzfrozenset[tuple[str, str]]_EQUIVALENT_SYMBOL_PAIRSabcl||krdS||ftvrdSt|t|kS)uReturn True if characters *a* and *b* are functionally equivalent. Equivalent means: - Same character, OR - Same base letter after stripping combining marks, OR - An explicitly listed symbol equivalence (e.g. ¤ ↔ €) T)rr)rrs r>_chars_equivalentrEsH Avt 1v))t A  "21"5"5 55r@databytesc||duS|dSt|p|}t|p|}||krdS ||}||}n#ttf$rYdSwxYw||krdSt |t |krdSt dt||dDS)uCheck whether *detected* produces functionally identical text to *expected*. Returns ``True`` when: 1. *detected* is not ``None`` and both encoding names normalize to the same codec, OR 2. Decoding *data* with both encodings yields identical strings, OR 3. Every differing character pair is functionally equivalent: same base letter after stripping combining marks, or an explicitly listed symbol equivalence (e.g. ¤ ↔ €). Returns ``False`` if *detected* is ``None``, either encoding is unknown, or either encoding cannot decode *data*. :param data: The raw byte data that was detected. :param expected: The expected encoding name, or ``None`` for binary files. :param detected: The detected encoding name, or ``None``. :returns: ``True`` if decoding with *detected* yields functionally identical text to decoding with *expected*. NFTc3<K|]\}}t||VdSri)r)rrrrs r>rtz*is_equivalent_detection..s1XX41a A&&XXXXXXr@)strict)rrdecodeUnicodeDecodeError LookupErrorlenallzip)rr{r|rrtext_exptext_dets r>is_equivalent_detectionrUs. 4ux((rsB0#"""""$$$$$$******,,,,,,+( YY* + ++( yy,011+(99gY''+( ii $$ +(  99i[ ! ! +(  II{G, - - +(G%5677+(ii!1 233+( ii())+(II~.//+( ii ""+( YYz " "+(.99RRRSS/+(0II~/?@AA1+(2II01223+(6))XJ''7+(8))XJ''9+(:)XJ'')XJ'')XJ'')XJ'')XJ''9hZ((ik233H:&&H:&&ik233H:&&H:&&U+(+(+( ++++f & &      7 7 7 7/%!%! X%! X %!  W %! H %! h%!y%! ,%!M%!-%!%!%!%!%! !%!" W#%!$ h%%!%!&M'%!()%!*k+%!,y-%!. h/%!0 h1%!23%!4 n5%!6 n7%!8 n9%!: n;%!< n=%!@ hA%!BC%!D