o jwA@sddlmZddlmZddlmZddZdZdZdZ d Z d Z d Z d Z d ZdZdZdZdZe eeeeeZGdddZGdddZGdddeZGdddeZedkrleZeZeedSdS))replace)Dict)CharactersConfigcCsttttttdS)N)padeosbos characters punctuationsphonemes)_pad_eos_bos _characters _punctuations _phonemesrrP/home/kuhnn/.local/lib/python3.10/site-packages/TTS/tts/utils/text/characters.py parse_symbolssrzzzz4ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyzz !'(),-.:;? u5iyɨʉɯuɪʏʊeøɘəɵɤoɛœɜɞʌɔæɐaɶɑɒᵻuʘɓǀɗǃʄǂɠǁʛuepbtdʈɖcɟkɡqɢʔɴŋɲɳnɱmʙrʀⱱɾɽɸβfvθðszʃʒʂʐçʝxɣχʁħʕhɦɬɮʋɹɻjɰlɭʎʟuˈˌːˑuʍwɥʜʢʡɕʑɺɧʲuɚ˞ɫc @seZdZdZd#dededededef dd Zed efd d Z ed efd dZ ed efddZ ed efddZ eddZ e jddZ eddZd$ddZeddZded efddZd ed efd!d"ZdS)%BaseVocabularyzBase Vocabulary class. This class only needs a vocabulary dictionary without specifying the characters. Args: vocab (Dict): A dictionary of characters and their corresponding indices. NvocabrblankrrcCs"||_||_||_||_||_dSN)rrrrr)selfrrrrrrrr__init__/s  zBaseVocabulary.__init__returncC|jr ||jSt|jS)zReturn the index of the padding character. If the padding character is not specified, return the length of the vocabulary.r char_to_idlenrrrrrpad_id6zBaseVocabulary.pad_idcCr)z~Return the index of the blank character. If the blank character is not specified, return the length of the vocabulary.rrrrr rrrblank_id<r"zBaseVocabulary.blank_idcCr)zzReturn the index of the bos character. If the bos character is not specified, return the length of the vocabulary.rrrrr rrrbos_idBr"zBaseVocabulary.bos_idcCr)zzReturn the index of the eos character. If the eos character is not specified, return the length of the vocabulary.rrrrr rrreos_idHr"zBaseVocabulary.eos_idcC|jS)z!Return the vocabulary dictionary._vocabr rrrrNszBaseVocabulary.vocabcCsRd\|_|_|_|dur'||_ddt|jD|_ddt|jD|_dSdS)zASet the vocabulary dictionary and character mapping dictionaries.)NNNNcSi|]\}}||qSrr.0idxcharrrr Yz(BaseVocabulary.vocab..cSi|]\}}||qSrrr-rrrr1Z )r+ _char_to_id _id_to_char enumeraterrrrrrSs cKsV|jdur"d|jvr"|jjr"t|jj|jj|jj|jj|jj|fStdi||fS)z!Initialize from the given config.N vocab_dictr)rr9rrrrr)configkwargsrrrinit_from_config^s zBaseVocabulary.init_from_configrc Cs t|j|j|j|j|jdddS)NF)r9rrrr is_unique is_sorted)rr+rrrrr rrr to_confignszBaseVocabulary.to_configcC t|jS)z*Return number of tokens in the vocabulary.rr+r rrr num_charsys zBaseVocabulary.num_charsr0c Cs<z|j|WSty}z tdt|d|d}~ww)zMap a character to an token ID. [!]  is not in the vocabulary.Nr5KeyErrorreprrr0errrr~s  zBaseVocabulary.char_to_idr/cC |j|S)zMap an token ID to a character.r6rr/rrr id_to_char zBaseVocabulary.id_to_char)NNNNrr)__name__ __module__ __qualname____doc__rstrrpropertyintr!r$r&r(rsetter staticmethodr<r?rBrrMrrrrr&s,      rc@seZdZdZ        dBdedededed ed ed ed ed dfddZed efddZ ed efddZ ed efddZ ed efddZ eddZ e jddZ eddZejddZeddZejd dZed!d"Zejd#d"Zed$d%Zejd&d%Zed'd(Zejd)d(Zed*d+Zejd,d+Zed-d.Zd/d0Zd1ed efd2d3Zd4ed efd5d6ZdCd8efd9d:ZedDd=d>ZdEd@dAZdS)FBaseCharactersu🐸BaseCharacters class Every new character class should inherit from this. Characters are oredered as follows ```[PAD, EOS, BOS, BLANK, CHARACTERS, PUNCTUATIONS]```. If you need a custom order, you need to define inherit from this class and override the ```_create_vocab``` method. Args: characters (str): Main set of characters to be used in the vocabulary. punctuations (str): Characters to be treated as punctuation. pad (str): Special padding character that would be ignored by the model. eos (str): End of the sentence character. bos (str): Beginning of the sentence character. blank (str): Optional character used between characters by some models for better prosody. is_unique (bool): Remove duplicates from the provided characters. Defaults to True. el is_sorted (bool): Sort the characters in alphabetical order. Only applies to `self.characters`. Defaults to True. NFTrr rrrrr=r>rc Cs<||_||_||_||_||_||_||_||_|dSr) rrr r r _blankr=r> _create_vocab rrr rrrrr=r>rrrrs  zBaseCharacters.__init__cCrrrr rrrr!zBaseCharacters.pad_idcCrrr#r rrrr$r]zBaseCharacters.blank_idcCrrr'r rrrr(r]zBaseCharacters.eos_idcCrrr%r rrrr&r]zBaseCharacters.bos_idcCr)r)rr rrrrzBaseCharacters.characterscC||_|dSr)rr[)rrrrrr cCr)r)rr rrrr r^zBaseCharacters.punctuationscCr_r)rr[)rr rrrr r`cCr)r)r r rrrrr^zBaseCharacters.padcCr_r)r r[)rrrrrrr`cCr)r)r r rrrrr^zBaseCharacters.eoscCr_r)r r[)rrrrrrr`cCr)r)r r rrrrr^zBaseCharacters.boscCr_r)r r[)rrrrrrr`cCr)r)rZr rrrrr^zBaseCharacters.blankcCr_r)rZr[)rrrrrrr`cCr)rr*r rrrrr^zBaseCharacters.vocabcCs6||_ddt|jD|_ddt|jD|_dS)NcSr,rrr-rrrr1r2z(BaseCharacters.vocab..cSr3rrr-rrrr1r4)r+r7rr5r6r8rrrr s  cCr@rrAr rrrrBrNzBaseCharacters.num_charscs6j}jr tt|}jrt|}t|}jdur)tjdkr)jg|n|}jdur=tjdkr=jg|n|}j durQtj dkrQj g|n|}j duretj dkrej g|n|}|tj _ jrfddj D}tj tj krtjksnJd|dSdS)Nrcs h|] }j|dkr|qS))rcount)r.xr rr %s z/BaseCharacters._create_vocab..z: [!] There are duplicate characters in the character set. )rr=listsetr>sortedrZrr r r rrr5r6)rr+ duplicatesrr rr[s$ ((((*zBaseCharacters._create_vocabr0c Cs<z|j|WSty}z tdt|d|d}~ww)NrCrDrErHrrrr*s  zBaseCharacters.char_to_idr/cCrJrrKrLrrrrM0s zBaseCharacters.id_to_charrlevelcCsd|}t|d|jt|d|jt|d|jt|d|jt|d|jt|d|jt|d|jt|d |jd S) z9 Prints the vocabulary in a nice format.  z| > Characters: z| > Punctuations: z | > Pad: z | > EOS: z | > BOS: z | > Blank: z | > Vocab: z| > Num chars: N) printrrr r r rZrrB)rriindentrrr print_log3szBaseCharacters.print_logr:CoqpitcCs<|jdurtdi|j|fSt}t||d}||fS)zcInit your character class from a config. Implement this method for your subclass. Nrr)rrYrr?r:r new_configrrrr<As zBaseCharacters.init_from_configrc Cs(t|j|j|j|j|j|j|j|jdS)Nrr rrrrr=r>) rrrr r r rZr=r>r rrrr?OszBaseCharacters.to_config)NNNNNNFT)rr:rnrO)rPrQrRrSrTboolrrUrVr!r$r(r&rrWr rrrrrrBr[rrMrmrXr<r?rrrrrYs$                   rYcfeZdZdZeeeeee ddfde de de de de d e d e d e d d ffdd Z e dddZZS) IPAPhonemesu-🐸IPAPhonemes class to manage `TTS.tts` model vocabulary Intended to be used with models using IPAPhonemes as input. It uses system defaults for the undefined class arguments. Args: characters (str): Main set of case-sensitive characters to be used in the vocabulary. Defaults to `_phonemes`. punctuations (str): Characters to be treated as punctuation. Defaults to `_punctuations`. pad (str): Special padding character that would be ignored by the model. Defaults to `_pad`. eos (str): End of the sentence character. Defaults to `_eos`. bos (str): Beginning of the sentence character. Defaults to `_bos`. blank (str): Optional character used between characters by some models for better prosody. Defaults to `_blank`. is_unique (bool): Remove duplicates from the provided characters. Defaults to True. is_sorted (bool): Sort the characters in alphabetical order. Defaults to True. FTrr rrrrr=r>rNc t||||||||dSrsuperrr\ __class__rrr| zIPAPhonemes.__init__r:rnc Csd|vrB|jdurBd|jvr|jjdur|jd|jd<t|jd|jd|jd|jd|jd|jd|jd |jd d |fS|jdurQtd i|j|fSt}t||d }||fS)zInit a IPAPhonemes object from a model config If characters are not defined in the config, it will be set to the default characters and the config will be updated. rNr r rrrrr=r>rrror)rr rvrr?rprrrr<s(  zIPAPhonemes.init_from_configrs)rPrQrRrSrrr r r rZrTrtrrXr< __classcell__rrrzrrv\s>!   rvcru) Graphemesu🐸Graphemes class to manage `TTS.tts` model vocabulary Intended to be used with models using graphemes as input. It uses system defaults for the undefined class arguments. Args: characters (str): Main set of case-sensitive characters to be used in the vocabulary. Defaults to `_characters`. punctuations (str): Characters to be treated as punctuation. Defaults to `_punctuations`. pad (str): Special padding character that would be ignored by the model. Defaults to `_pad`. eos (str): End of the sentence character. Defaults to `_eos`. bos (str): Beginning of the sentence character. Defaults to `_bos`. is_unique (bool): Remove duplicates from the provided characters. Defaults to True. is_sorted (bool): Sort the characters in alphabetical order. Defaults to True. FTrr rrrrr=r>rNc rwrrxr\rzrrrr|zGraphemes.__init__r:rnc Cs|jdur:d|jvr0t|jd|jd|jd|jd|jd|jd|jd |jd d |fStd i|j|fSt}t||d }||fS)zInit a Graphemes object from a model config If characters are not defined in the config, it will be set to the default characters and the config will be updated. Nr rr rrrrr=r>rrror)rr~rr?rprrrr<s$    zGraphemes.init_from_configrs)rPrQrRrSrrr r r rZrTrtrrXr<r}rrrzrr~s>   r~__main__N) dataclassesrtypingrTTS.tts.configs.shared_configsrrr r r rZrr_vowels_non_pulmonic_consonants_pulmonic_consonants_suprasegmentals_other_symbols _diacrilicsrrrYrvr~rPgrphrmrrrrs8   dSNG