޺i*0 %SrSSKJr SSKJrJr SSKJr S\S\ \ \ \ 44Sjr S\S\ \ \ \ 44Sjr S\S\ \ \ \ 44S jrS\S\ \ \ \ 44S jrS\S\ \ \ \ 44S jrS\S\ \ \ \ 44S jr\ \ \ \\\\\S .r\\\\/\ \ \ \ 444\S'S\S\S\S\ \ \ \ 4S-4SjrS\S\S\S\ 4SjrSS\S\S\S\ S-S\ 4 SjjrS\S\S\S\ 4Sjrg)aStage 2b: Multi-byte structural probing. Computes how well byte patterns in the data match the expected multi-byte structure for a given encoding. Used after byte-validity filtering (Stage 2a) to further rank multi-byte encoding candidates. Note: ``from __future__ import annotations`` is intentionally omitted because this module is compiled with mypyc, which does not support PEP 563 string annotations. )Callable) HIGH_BYTESPipelineContext) EncodingInfodatareturncSnSnSn[5nSn[U5nXV:aXnSUs=::aS::dO SUs=::aS::ajO OgUS- nUS-U:aSXS-nSUs=::aS::dO S Us=::aS ::a0O O-US- nURU5 US- nUS :aUS- nUS - nMUS- nOUS- nXV:aMUS:aX!- OS n X[U54$)zSingle-pass Shift_JIS / CP932 structural analysis. Lead bytes: 0x81-0x9F, 0xE0-0xEF Trail bytes: 0x40-0x7E, 0x80-0xFC Returns (pair_ratio, mb_bytes, lead_diversity). r@~setlenadd r lead_count valid_countmbleadsilengthbtrailratios Z/var/www/piano.thomer.com/venv/lib/python3.13/site-packages/chardet/pipeline/structural.py_analyze_shift_jisr%sJK BeE A YF * G A  41#4#4 !OJ1uv~U E)T)tu/D/D1$KIIaL!GBt|aFA FA FA# *$)3QK $CE c%j  cSnSnSn[5nSn[U5nXV:Ga$XnUS:XaKUS- nUS-U:a7SXS-s=::aS::a%O O"US- nURU5 US- nUS- nMUUS- nOUS:Xa`US- nUS-U:aLSXS-s=::aS::a:O O7SXS-s=::aS::a%O O"US- nURU5 US - nUS - nMUS- nOaSUs=::aS::aOO OLUS- nUS-U:a8SXS-s=::aS::a&O O#US- nURU5 US- nUS- nGMUS- nOUS- nXV:aGM$US:aX!- OS nX[U54$) zSingle-pass EUC-JP structural analysis. Two-byte: Lead 0xA1-0xFE, Trail 0xA1-0xFE SS2 (half-width katakana): 0x8E + 0xA1-0xDF SS3 (JIS X 0212): 0x8F + 0xA1-0xFE + 0xA1-0xFE Returns (pair_ratio, mb_bytes, lead_diversity). rrrrr rrrrrrr r!r#s r$_analyze_euc_jpr/EsJK BeE A YF * G 9 !OJ1uv~$$1u+"="=q  ! aQ FA $Y !OJADQK/4/DQK/4/q  ! aQ FA Q $  !OJ1uv~$$1u+"="=q  ! aQ FA FAI *J)3QK $CE c%j  r&cNSnSnSn[5nSn[U5nXV:akXnSUs=::aS::aNO OKUS- nUS-U:a7SXS-s=::aS::a%O O"US- nURU5 US- nUS- nM^US- nOUS- nXV:aMkUS:aX!- OSnX[U54$)zSingle-pass EUC-KR / CP949 structural analysis. Lead 0xA1-0xFE; Trail 0xA1-0xFE Returns (pair_ratio, mb_bytes, lead_diversity). rr)r,rrrrr.s r$_analyze_euc_krr1sJK BeE A YF * G 1   !OJ1uv~$$1u+"="=q  ! aQ FA FA *)3QK $CE c%j  r&cBSnSnSn[5nSn[U5nXV:aXnSUs=::aS::aO OUS- nUS-U:aaSXS-s=::aS::aOO OLSXS-s=::aS::a:O O7SXS-s=::aS::a%O O"US- nURU5 US- nUS - nMS Us=::aS ::aCO O@US-U:a7S XS-s=::aS::a%O O"US- nURU5 US- nUS- nMUS- nOUS- nXV:aMUS:aX!- OS nX[U54$) aSingle-pass GB18030 / GB2312 structural analysis. Only counts strict GB2312 2-byte pairs (lead 0xA1-0xF7, trail 0xA1-0xFE) and GB18030 4-byte sequences. The broader GBK extension range (lead 0x81-0xFE, trail 0x40-0x7E / 0x80-0xFE) is intentionally excluded because it is so permissive that unrelated single-byte data (EBCDIC, DOS codepages, etc.) can score 1.0, leading to false positives. Returns (pair_ratio, mb_bytes, lead_diversity). rr r,rr-09rr)rrr.s r$_analyze_gb18030r7sGJK BeE A YF * G 1   !OJADQK/4/DQK/4/DQK/4/q  ! aQq D QUV^U 8St8Sq  ! aQ FA FA3 *4)3QK $CE c%j  r&cSnSnSn[5nSn[U5nXV:aXnSUs=::aS::ajO OgUS- nUS-U:aSXS-nSUs=::aS::dO SUs=::aS::a0O O-US- nURU5 US- nUS:aUS- nUS - nMzUS- nOUS- nXV:aMUS:aX!- OS n X[U54$) zSingle-pass Big5 structural analysis. Lead 0xA1-0xF9; Trail 0x40-0x7E, 0xA1-0xFE Returns (pair_ratio, mb_bytes, lead_diversity). rr)rrrr,rrrrrs r$ _analyze_big5r:sJK BeE A YF * G 1   !OJ1uv~U E)T)tu/D/D1$KIIaL!GBt|aFA FA FA# *$)3QK $CE c%j  r&cSnSnSn[5nSn[U5nXV:aXnSUs=::aS::d!O SUs=::aS::dO SUs=::aS::apO OmUS- nUS-U:aYXS-nS Us=::aS ::dO S Us=::aS ::a6O O3US- nURU5 US :aUS- nUS :aUS- nUS- nMUS- nOUS- nXV:aMUS:aX!- OSn X[U54$)zSingle-pass Johab structural analysis. Lead: 0x84-0xD3, 0xD8-0xDE, 0xE0-0xF9 Trail: 0x31-0x7E, 0x91-0xFE Returns (pair_ratio, mb_bytes, lead_diversity). rr r9r1rr,rrrrrs r$_analyze_johabrBs JK BeE A YF * G A  41#4#4$!:Kt:K !OJ1uv~U E)T)tu/D/D1$KIIaL4xat|aFA FA FA# *$)3QK $CE c%j  r&)shift_jis_2004cp932 euc_jis_2004euc_krcp949gb18030 big5hkscsjohab _ANALYZERSnamectxNcURRU5nUbU$[RU5nUcgU"U5nXRRU'U$)z/Return cached analysis or compute and cache it.N)analysis_cachegetrK)rrLrMcachedanalyzerresults r$ _get_analysisrT+sX   # #D )F  ~~d#H d^F%t Mr& encoding_infocrU(aUR(dg[XRU5nUcgUS$)ayReturn 0.0--1.0 indicating how well *data* matches the encoding's structure. For single-byte encodings, always returns 0.0. For empty data, always returns 0.0. :param data: The raw byte data to analyze. :param encoding_info: Metadata for the encoding to probe. :param ctx: Pipeline context for caching analysis results. :returns: A structural fit score between 0.0 and 1.0. rr is_multibyterTrLrrUrMrSs r$compute_structural_scorerZ?s6 }11 4!3!3S 9F ~ !9r&non_ascii_countcU(aUR(dg[XRU5nUcgUSnUbUO*[U5[UR S[ 55- nUS:XagXV- $)aNRatio of non-ASCII bytes that participate in valid multi-byte sequences. Genuine CJK text has nearly all non-ASCII bytes paired into valid multi-byte sequences (coverage close to 1.0), while Latin text with scattered high bytes has many orphan bytes (coverage well below 1.0). :param data: The raw byte data to analyze. :param encoding_info: Metadata for the encoding to probe. :param ctx: Pipeline context for caching analysis results. :param non_ascii_count: Pre-computed count of non-ASCII bytes, or ``None`` to compute from *data*. :returns: A coverage ratio between 0.0 and 1.0. rNrr)rXrTrLr translater)rrUrMr[rSmb_bytes non_asciis r$compute_multibyte_byte_coverager`Vsx& }11 4!3!3S 9F ~ayH  &  YT^^D*=> > A~  r&crU(aUR(dg[XRU5nUcgUS$)aCount distinct lead byte values in valid multi-byte pairs. Genuine CJK text uses lead bytes from across the encoding's full repertoire. European text falsely matching a CJK structural scorer clusters lead bytes in a narrow band. :param data: The raw byte data to analyze. :param encoding_info: Metadata for the encoding to probe. :param ctx: Pipeline context for caching analysis results. :returns: The number of distinct lead byte values found. rrrWrYs r$compute_lead_byte_diversityrc}s6 }11 4!3!3S 9F ~ !9r&)N)__doc__collections.abcrchardet.pipelinerrchardet.registryrbytestuplefloatintr%r/r1r7r:rBrKdictstr__annotations__rTrZr`rcr&r$rps %8) #! #! 5#s?#!L7! 7! 5#s?7!t! ! 5#s?!@.! .! 5#s?.!b"! "! 5#s?"!J#! #! 5#s?#!V) #   D DhweS#o(>>?? @     !0  5#s?d" (  ,3B 6#' $ $ $  $ 4Z $  $ N  ,3Br&