Announcement

Collapse

Please use the Hentai ID thread for all hentai ID requests. Click me for link!

The Identification Thread is Here:

http://www.hongfire.com/forum/showthread.php/447081
See more
See less

Interactive Text Hooker - new text extraction tool

Collapse
X
  • Filter
  • Time
  • Show
Clear All
new posts

  • #16
    ITH now can suppress repetition like AGTH with /KF option on now, but it uses different heuristic to approach the goal.
    Currently I can't come out with a perfect method that can detect repetition precisely,
    so maybe sometimes ITH can't give ideal clean output.
    If you encounter such situation, please help me record that.
    If I am able to reproduce the situation then an improved heuristic will overcome that.
    Last edited by kaosu; 10-03-2010, 04:35 AM.
    sigpic
    Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
    http://www.hongfire.com/forum/showthread.php?t=208860

    Comment


    • #17
      First release version of ITH is out. Currently ITH support 11 types of popular game engines.
      More engines will be added later to increase the detect rate.
      sigpic
      Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
      http://www.hongfire.com/forum/showthread.php?t=208860

      Comment


      • #18
        Is ITH capable of ignoring the first line on outputted text? I could never get AGTH to do that. I'm referring to games that treat the name in the upper left as part of the text window, such as "Escalation Hardcore" (see image). Text Hookers seem to have issues ignoring dialog with names displayed, like this:

        Click image for larger version

Name:	escalationTextEx.jpg
Views:	1
Size:	73.3 KB
ID:	4837208

        Comment


        • #19
          @ReMeDy: If ITH can't split names into different threads by default,
          you will have to find out a special option(h-code) to help ITH identify names from text.

          I have ITH tested on 25 major games released during July.
          ITH works well with 22 of them, achieves a detect rate of 88%.
          Generally it's assumed to be over 70% right now.
          Here's a test list:
          O means ITH can extract text from game without special codes.
          X means can't work by default. Need a h-code to insert userhook.
          Spoiler

          O[100723][raiLsoft]信天翁航海録 ---Default
          O[100722][あっぷりけ]黄昏のシンセミア ---KiriKiri
          O[100723][ROOT]PARA-SOL ---Default
          O[100723][Tinker Bell]サマヨイ淫夢校舎 ~こんな授業ありえないっ!~ ---TinkerBell
          O[100723][アトリエかぐや P-ch]クラ☆クラ ~CLASSY☆CRANBERRY’S~ ---Default
          O[100723][Cassiopeia]げきたま! ~青陵学園演劇部~ 初回限定版 ---Default
          O[100723][Lose]ゴスデリ -GOTHIC DELUSION- ---KiriKiri
          O[100723][MAIKA]秘書 沙織 ---KiriKiri
          O[100723][裸足少女]女医さんのお言いつけっ!!~エッチな診察してあげる♪~ ---RealLive
          O[100730][age]マブラヴ オルタネイティヴ クロニクルズ01 ---rUGP
          O[100730][ALcotハニカム]VESTIGE -刃に残るは君の面影- ---ShinaRio
          X[100730][CandySoft]もっと 姉、ちゃんとしようよっ! ---X
          O[100730][chuablesoft]Sugar+Spice2 ---KiriKiri
          O[100730][Escu:de]乙女恋心プリスターFANDISC ~もっとHに恋せよ乙女!~ ---Default
          X[100730][Love Juice]オレの姉ちゃん。~オレは姉ちゃんのオモチャじゃないっ!~ ---X
          O[100730][Navel]俺たちに翼はない AfterStory - Limited Edition - ---Lucifen
          O[100730][ninetail]遠望のフェルシス Horizon of the earth and sky ---KiriKiri
          O[100730][Potage(ポタージュ)]籠の中の彼女~カ・ゴ・カ・ノ~ ---KiriKiri
          O[100730][TOPCAT]ななプリ。 ---Default
          O[100730][Whirlpool]MagusTale W-Pack ---Default
          O[100730][アトリエかぐや]すぷらっしゅ! ---Default
          X[100730][でぼの巣製作所]空を仰ぎて雲たかく ---X
          O[100730][ぱれっと]すてぃ~るMyはぁと~Rhapsody of moonlight~ ---Default
          O[100730][ソフトハウスキャラ]BUNNYBLACK ---SofthouseChara
          O[100730][ローズクラウン]娼母清華 ~背徳の交わり~ ---KiriKiri
          Last edited by kaosu; 11-04-2010, 08:43 PM.
          sigpic
          Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
          http://www.hongfire.com/forum/showthread.php?t=208860

          Comment


          • #20
            I tested some games, OS: Windows 7
            [100618][OVERDRIVE] DEARDROPS -- working (BGI)

            Norn games, I think have same problem :
            [100326] [Norn Soft] 完璧お姉さま御子神沙耶の無人島孕ませ修行~ふふ、元気のいい精子だ…早く私に妻の証を宿してくれ~\
            [100625] [Norn Soft] 魔界プリンセスフィリーネの優雅な搾精ライフ ~打ち止めなんて許さないわよ~\
            [100716] [Norn Soft] ツンデレ妹は孕ませ希望の発情期!~責任とって中に出してよね!変態おにぃ!~\
            [100716] [Norn Soft] 大天使ミカエラ様の孕ませ審判~いいでしょう、好きなだけ出しなさい。私は快楽などに負けません!~\
            [100910] [Norn Soft] 聖乳の巫女お姉ちゃん瑠璃~癒しの母乳で中出し生活~\
            [101008] [Norn Soft] 軍人少女の子作り任務~ハレンチな!…う、上官命令なら…貴方の精子で子宮を撃ち抜いてください!~\

            After processing some text this message appear, see attachment :
            The error occurred.
            File: Scenario.ks Line: XX
            Tag: Ch(<-Tag before and after the error's occurring might be shown)
            EAccessViolation

            Spoiler

            Inject process 3512. Module base 10000000

            3512: tunhin.exe
            3512: Pipe connected.
            3512: 00400000:007f7000
            3512: 3798F351347E71964A8CB8577A5E4D5E
            3512: CALL addr:0x0054170C
            3512: Hook addr: 0x00541254
            3512: KiriKiri2
            3512: Additional hook inserted.
            3512: Insert address 0x00541254.
            3512: CALL addr:0x00542318
            3512: Hook addr: 0x00549467
            3512: KiriKiri1
            3512: Additional hook inserted.
            3512: Insert address 0x00549467.
            3512: Initialized successfully

            0001:3512:0x7795B535:0x0054231E:0x00000000:GetText ExtentPoint32W
            0002:3512:0x00549467:0x00000000:0x00000014:KiriKir i1
            0003:3512:0x00541254:0x00547A1A:0x00000011:KiriKir i2
            0004:3512:0x7797C292:0x00541712:0x00000000:GetGlyp hOutlineW
            0005:3512:0x7795B535:0x00541796:0x00000000:GetText ExtentPoint32W
            0006:3512:0x7797C292:0x00541A3C:0x00000000:GetGlyp hOutlineW
            0007:3512:0x00549467:0x00000000:0x00000012:KiriKir i1

            0008:3512:0x76CC7BDD:0x0FFF40B4:0x00000000rawTextExW
            0009:3512:0x77958053:0x0FFF3EEC:0x00000000:ExtText OutW

            000A:3512:0x7795B535:0x0FFF3C57:0x00000000:GetText ExtentPoint32W

            000B:3512:0x00549467:0x00000000:0x0000000C:KiriKir i1
            000C:3512:0x00541254:0x00547F9E:0x0000000A:KiriKir i2
            000D:3512:0x7797C292:0x0FFF3A94:0x00000000:GetGlyp hOutlineW

            Process 3512 detached.


            [090918][ALICESOFT]ももいろガーディアン (Momoiro Guardian)
            Looks need h-code, but I don't know if I'm doing right or not...
            Using h-code /HB38@623F0:StoatSpriteEngine.dll
            Spoiler

            Process 1984 detached.

            Try to insert additional hook.

            Inject process 1984. Module base 01C50000
            1984: momonga.exe
            1984: Pipe connected.
            1984: 00400000:0044b000
            1984: 9FFE577625AF8BB67517624AC4DE523B
            1984: Unknown engine.
            1984: Initialized successfully

            Try to insert additional hook.
            1984: Module not present.
            1984: Unable to insert hook.



            Also, how to use Hook Editor? @_@
            Attached Files

            Comment


            • #21
              @errzotl80: Error is fixed. ITH didn't handle some system call very well. Information about hook window is added.
              You need to know what every part of a h-code string means to utilize hook manager.

              ITH v1.2 is out.
              New engine support: TinkerBell, Lune, SofthouseChara
              Old engine detect heuristics refined: CMVS, System40, ShinaRio
              Last edited by kaosu; 10-17-2010, 07:00 AM.
              sigpic
              Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
              http://www.hongfire.com/forum/showthread.php?t=208860

              Comment


              • #22
                Nice, I'll try it later

                *Edit:
                I tried new version, yes, now Momonga Guardian working fine.

                Another problem, it seems if we don't detach manually, the game will not closed properly. If you check it on task manager, it still running.
                Here's the chronology :
                1. Run ITH
                2. Run game
                3. Attach the game
                4. Close the game
                5. Close ITH

                *Edit2:
                About clipboard function :
                When enabled, then we switched to another thread, the copy function not working.
                Even when you switched back to original thread, it's still not working.
                Another trigger is when there are a sudden text flooding (i.e on Kirikiri), though this sudden text flooding is very rare case, but you might want to note it. (Here, I didn't use supress repetition option, because once before I had ITH crashes when enabling it. I'll test this matter later).
                The copy function will working again after enabling/disabling supress button + process some text.

                About Kirikiri engine hooking detection :
                So I was tried to compare text captured by AGTH and ITH. I tried with the same game.

                First is WLO - World Love Organization.
                As you can see at the picture, it has the same address (0x00547A1A), but different subcontext. AGTH = 18, while ITH = 15.
                Subcontext 18 don't have sudden text flooding, while subcontext 15
                had it.

                Another test is with Norn games.
                Same address (0x00547A1A), but different subcontext (AGTH = 14, ITH = 11).
                Result are the same, sudden text flooding, plus line break too.

                ITH is not showing thread that AGTH showed.(subcontext 18 & 14)
                You might want to change the hooking detection so it also showing the same subcontext as AGTH does.
                If you ask me why it is needed, just see at the picture.
                Of course, I already turned off the supress repetition option in both AGTH and ITH, to make sure that the text captured
                is still intact.
                I just want to pointing out that AGTH might have better subcontext selection, which should be implemented into your ITH too.
                Well, people maybe didn't bothered with this case, just choose another thread, it doesn't matter.

                Btw please be mind this comparison method might be not accurate...
                Attached Files
                Last edited by errzotl80; 10-25-2010, 03:00 AM.

                Comment


                • #23
                  @errzotl80: Thank you for your work on testing this program.
                  Those irregular cases is very important for me to improve ITH.

                  I've also randomly seen game doesn't exit after attached before.
                  Seems the problem is synchronization scheme of ITH.
                  I have modified it a lot but this case may still occur in the future.

                  Hook of Kirikiri engine is also under refining, I'm studying the case of WLO.
                  I noticed that process name is not displayed normally in the second and third picture.
                  Seems it's bugs in my code. If you can reproduce that situation it will be a lot of help.
                  Text flood issue should be fixed.

                  I think issue of line break is due to split time. Currently I set it to 200ms,
                  means if after 200ms ITH receive nothing then a line break inserted.
                  I choose this value just because it's my preference.
                  You will be able to modify this value in the next version.
                  Current solution is set text display speed to a relative fast level.

                  New version 1.4 will release in this week, also with new feature of profile.
                  ITH will monitor process on the system and attach to some automatically.

                  Here's a test version. New features not working now.
                  But it has some bug fixed. Please have a try and see if dead process issue still occurs usually.
                  Last edited by kaosu; 10-30-2010, 07:00 PM.
                  sigpic
                  Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
                  http://www.hongfire.com/forum/showthread.php?t=208860

                  Comment


                  • #24
                    Uhh... picture 2 & 3 are from a Norn Game, not WLO ^^;;;
                    The title is [100326] [Norn Soft] 完璧お姉さま御子神沙耶の無人島孕ませ修行~ふふ、元気のいい精子だ…早く私に妻の証を宿してくれ~
                    Maybe another Norn Games have the same "process name" problem too. I'll try it later.

                    Also about line break on Kirikiri engine, I can't conclude wether it's because split time or not,
                    because as you can see, the subcontext address is different.
                    In WLO :
                    AGTH = 0x00547A1A:00000018
                    ITH = 0x00547A1A:00000015

                    In [100326] [Norn Soft] 完璧お姉さま御子神沙耶の無人島孕ませ修行~ふふ、元気のいい精子だ…早く私に妻の証を宿してくれ~ :
                    AGTH = 0x00547A1A:00000014
                    ITH = 0x00547A1A:00000011

                    Comment


                    • #25
                      Ah..Subcontext value just have little influence on text stream I think.
                      Anyway, ITH now use same subcontext for KiriKiri as AGTH.

                      ITH 1.4 is out. New feature of profile is ready.
                      sigpic
                      Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
                      http://www.hongfire.com/forum/showthread.php?t=208860

                      Comment


                      • #26
                        I tried ITH 1.4 with these Kirikiri based games :
                        Spoiler

                        [100326] [Norn Soft] 完璧お姉さま御子神沙耶の無人島孕ませ修行~ふふ、元気のいい精子だ…早く私に妻の証を宿してくれ~
                        [100625] [Norn Soft] 魔界プリンセスフィリーネの優雅な搾精ライフ ~打ち止めなんて許さないわよ~
                        [100716] [Norn Soft] ツンデレ妹は孕ませ希望の発情期!~責任とって中に出してよね!変態おにぃ!~
                        [100716] [Norn Soft] 大天使ミカエラ様の孕ませ審判~いいでしょう、好きなだけ出しなさい。私は快楽などに負けません!~
                        [100910] [Norn Soft] 聖乳の巫女お姉ちゃん瑠璃~癒しの母乳で中出し生活~
                        [101008] [Norn Soft] 軍人少女の子作り任務~ハレンチな!…う、上官命令なら…貴方の精子で子宮を撃ち抜いてください!~
                        [090326][あかべぇそふとつぅ]W.L.O.世界恋愛機構

                        It seems proccess title is working fine now.
                        Also the text captured properly, good job Kaosu

                        Comment


                        • #27
                          ITH 1.5 is out. From now on, engine detect function become a independent module.
                          I will continuously update this module with new game engine, while the main ITH doesn't have to change.
                          sigpic
                          Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
                          http://www.hongfire.com/forum/showthread.php?t=208860

                          Comment


                          • #28
                            Thanks for this great app. Setx stopped developing AGTH and it's not open source. It's good to have an open source application, that is actively developed.

                            What do you think about adding support for getting the H-Code for a game from an online database? Or maybe ITH could get the whole database from the internet. The database would contain a hash for the executable file and the H-Code. I think this would be a "killer" feature that would make everybody switch from AGTH.
                            AGTH wiki

                            Comment


                            • #29
                              @Stomp: Great idea! Get hook codes online then will free people from searching codes,
                              also function properly while user has no knowledge about UserHooks.
                              Something make me haven't implement it is that I need to be very careful with any data from the internet.
                              Ensure that ITH won't become a security vulnerability either do any damage to user's computer.
                              Another issue is that I don't have a server online. I see some awesome people maintaining database.
                              I will want to contact them and discuss a interface then.
                              I've considered about designing a mechanism like DHT used in p2p software to achieve this goal.
                              Also called DHT, but this time it becomes Distributed H-codes Table
                              This is only possible when there is quite a large group of users. I don't know how many people is like to use this.
                              Anyway, I will take this idea into plan then.
                              sigpic
                              Got stuck at AGTH H-codes? Have a try of ITH, supports more game engine.
                              http://www.hongfire.com/forum/showthread.php?t=208860

                              Comment


                              • #30
                                Here is some ideas (Not sure workable or not)


                                How about making a webpage that allows ppls to input the
                                H-codes + Name of game + version of game + Comapany name, and maybe a pic/cover image of the game,
                                and maybe some other info like Does it need to mount Image to play and NoDVD Patch avaliable [Extra optional]

                                Then store the important info like H-codes + Name of game + version of game + Comapany name
                                into a DB or txt file [Encryption up to you]
                                Then make a duplicated copy and place it on another folder [For backup] (Automatic / Manual depends on you)

                                Then the DB or txt file can then be make avaliable using a link that can be downloaded from the website and/or
                                pull from the program using that link and save it on the HDD in the ITH folder maybe in the folder named "Database"

                                thats what i can think of keke
                                just need a free web host maybe with PHP / MySQL (for Database route)
                                or HTML/PHP + normal Text file (for Txt route)

                                Problem is how to append to file instead of overwriting it...
                                Things To be uploaded Next: Will upload If possible...
                                Quote: Anything that can be downloaded will be downloaded regardless the content
                                All My Latest Stuffs, please [Visit Here] Most Updated!!!
                                Featured Game DDL:[KISS] カスタムメイド3D [Custom Maid 3D] ,please [Visit Here]
                                For my H-Movie/Animes DDL links, please [Visit Here]

                                Comment

                                Working...
                                X