1. Ngā here o Catastrophic Forgetting me RAG
Ina whakamahia a AI ki ngā mahi tūturu, ko tētahi o ngā tino āwangawanga ko te āhuatanga o te wareware kino (Catastrophic Forgetting) ka puta ina whakangungua anō ngā mōhiotanga kua akona i mua mā te whakamahi i ngā raraunga hou.
Ko te āhuatanga tēnei ka ngaro ohorere ai ngā mōhiotanga me ngā tauira i akona i mua, i te wā e ako ana te AI e hāngai ana ki te whatunga neura i ngā pārongo hou.
Hei tauira, mēnā ka whakangungua anō tētahi LLM puna-tuwhera mā ngā raraunga o tētahi kamupene, ka heke pea ngā mōhiotanga whānui me ngā āheinga reo.
Hei karo i tēnei raruraru, he whānui te whakamahinga o te hangarau RAG(Retrieval-Augmented Generation), engari he here anō tō RAG.
Ngā here matua o RAG
- He iti te tukatuka raraunga hanganga (Structured Data QA): He mea tino arotau ngā pūnaha RAG ki ngā tuhinga kuputuhi kāore he hanganga, nō reira kāore e taea e rātou te mārama tika, te whakamahi rānei i ngā tikanga me ngā hononga o ngā raraunga hanganga (pērā i ngā tēpu, pātengi raraunga, ripanga horahanga me ērā atu).
- Ngā here mō ngā PDF matatini/tuhinga kāore he hanganga (Complex PDFs): Mō ngā tuhinga PDF matatini (pērā i ngā tēpu, ngā pou maha, ngā whakaahua me ērā atu), ka ngaro pea ngā mōhiohio, ka whakarerekēhia rānei te horopaki i te wā o te chunking (wehewehe). Nā konei, kāore pea ngā raraunga hira e taupūtia, ka uaua rānei te rapu.
- Kāore he tauira Fallback (Fallback Model(s)): Ina kore e kitea e te pūnaha RAG he whakautu tika, he ngoikore, he koretake rānei te arorau mō te whakawhiti ki tētahi tauira kē (tautoko). Nā konei, ina rahua te whakautu, kāore pea e tukuna he kōwhiringa kē e pai ai te kaiwhakamahi.
- Ngā whakaraeraetanga haumarutanga (LLM Security): He ngoikore pea ngā parepare ki ngā whakaraeraetanga haumarutanga o te LLM ake (pērā i te weronga tohutohu, te turuturu raraunga me ērā atu), ka tūpono ai te puta o ngā mōhiohio tairongo.
- He iti te whakawhānuitanga (Data Ingestion Scalability): Ka puta ngā raru whakawhānui i te wā e taupūtia ana, e penapenatia ana ngā raraunga nui. Ka nui haere ngā raraunga, ka pōturi haere te chunking, te penapena me te rapu, ā, ka piki ake te kawenga o te pūnaha.
- Kua ngaro ngā mōhiohio hira (Missing Content): He maha ngā wā ka ngaro ngā kōrero hira i te tuhinga i te wā o te chunking, kāore rānei e taupūtia. Nā konei, kāore e taea e te kaiwhakamahi te rapu i ngā mōhiohio e hiahiatia ana.
- Kua ngaro te tūranga teitei (Missed Top Ranked): Tērā pea ka ngaro te chunk (tūranga teitei) e tino hāngai ana i roto i ngā hua rapu. Ko ngā take pea ko ngā here o te hātepe rapu, te hekenga o te kounga embedding, me ngā hapa whakarārangi.
- Kāore e hāngai ana te horopaki (Not in Context): He maha ngā wā kāore te chunk i rapua e hāngai ana ki te horopaki tūturu o te pātai. Nā ngā here o te rapu e ahu ana ki te ōritetanga noa, he iti te hononga ā-kaupapa.
- Hē te hōputu (Wrong Format): Tērā pea kāore te hōputu o te chunk i rapua e tika ana mā te LLM e tukatuka, kāore rānei e rite ki te hōputu whakautu e hiahia ana te kaiwhakamahi. Hei tauira, ka hē pea ngā mōhiohio ina hurihia he tēpu hei kuputuhi.
- Kāore i taea te tango mōhiohio (Not Extracted): Tērā pea kāore ngā mōhiohio e hiahiatia ana e tika ana te tango mai i te chunk, kāore rānei te LLM e mōhio ki aua mōhiohio. He maha ake te puta o tēnei i ngā hanganga rerenga kōrero matatini, ngā tēpu, ngā whakaahua me ērā atu.
- Kāore e tika ana te whānui/hōhonu o ngā mōhiohio (Incorrect Specificity): Tērā pea he whānui rawa te whakautu mō te pātai, he tino taipitopito rawa rānei, ā, kāore e hāngai ana ki ngā hiahia tūturu o te kaiwhakamahi. He uaua te whakatika i te whānui me te hōhonu o ngā mōhiohio.
- He whakautu kāore i oti (Incomplete): I te mutunga, tērā pea kāore i oti te whakautu i hangaia, he wāhanga mōhiohio noa iho rānei ka tukuna, kāore e tino whakatutuki ana i ngā hiahia o te kaiwhakamahi. Ko ngā take pea ko te kore e whakakotahi i ngā mōhiohio mai i ngā chunk maha, ko te whakamahi wāhanga noa iho rānei a te LLM.
Nā te tino whakawhirinaki o RAG ki te rapu ōritetanga vector me te taupū e hāngai ana ki ngā chunk, ka tino kitea ōna herenga i roto i ngā mahi tūturu mō te pono, te whakawhānui, me te tika.
2. Te Pātengi Raraunga Semantic a CLEVI kua whakakore i ngā herenga o RAG
Hei whakakore i ēnei herenga, kua whakawhanakehia e CLEVI te hanganga mātauranga AI o te reanga hou, arā, te hononga ā-hinengaro, te whakaaroaro matatini, me ngā whakautu e takea ana i ngā taunakitanga, kua arotakengia mō te Clevi Semantic Database.
He otinga ka taea nā te mea kei a ia ake ngā tauira Reasoning, ngā AI multimodal, me ngā tauira AI momo kaihoko katoa; ā, koinei tētahi o ngā hangarau kaha motuhake a CLEVI e taea ai e AI te tino āwhina i te ao tūturu.
Hei whakataurite, mēnā he whare pukapuka te pātengi raraunga e penapena ana i ngā mōhiohio, whakaarohia ko te Pātengi Raraunga Semantic a CLEVI he kaipupuri pukapuka tino matatau. (Mēnā ka tono koe i ngā mōhiohio e hiahiatia ana ki te kaipupuri pukapuka, ka whiwhi koe i tētahi whakautu tika, tere hoki.)
Ka taea e ngā kaiwhakamahi te tāpiri mōhiohio hou ki te whare pukapuka me te tiki mai i ngā mōhiohio e hiahiatia ana i ngā wā katoa.
Ka taea hoki te whakarite i te whakahaere putanga o ngā raraunga me ngā whakaaetanga uru kia rite ki tāu e hiahia ai.
Ka tuhia ngā mahi katoa a te kaipupuri pukapuka hei rangitaki (pūrongo), nō reira, ahakoa ka puta he hapa, ka taea te whakatika.
<Clevi Semantic Database Structure>
Ngā āhuatanga matua me te hanganga hangarau
Te penapena raraunga ā-hinengaro
- Kāore i te mea he vectorDB chunk noa iho; ka penapenahia ngā hononga ā-hinengaro i waenga i ngā raraunga (te horopaki, te arorangi, te take me te pānga, me ērā atu) ki roto i te pātengi raraunga kauwhata
- He ngāwari te whakawhānui me te whakapai ake hei kauwhata mātauranga, hei whatunga semantic hoki
Te rapu me te whakaaroaro ranu
- CTA+Context Query: Ka whakaarohia tahitia te horopaki (Context) o te pātai me te CTA
- Hybrid Retrieval: Ka whakakotahitia te ōritetanga vector me te rapu e hāngai ana ki ngā ture/kauwhata
- Intelligent Folder Hits: Ka rapua aunoa ngā kōpaki/kāwai e whai hononga ā-hinengaro ana
Te tukatuka multimodal tukutahi
- TextReader Pool, VisionReader Pool me ērā atu: ka whakamāramahia tahitia ngā momo raraunga pēnei i te kuputuhi, ngā atahanga, ngā ripanga, me te reo
- Ahakoa ko te RAG o mua te nuinga ka taea anake te tukatuka kuputuhi, he tino kaha te Pātengi Raraunga Semantic ki te tukatuka multimodal
Ngā whakautu e takea ana i ngā taunakitanga me te manatoko pono
- Ngā Whakarāpopototanga Tuhinga me ngā Tohutoro, Ngā Kitenga Ripanga: te hanga aunoa i ngā whakarāpopototanga me ngā puna
- Merge & Verify: te whakakotahi ā-kaupapamaha i ngā pārongo mai i ngā puna maha me te manatoko i te whaitikanga
- Evidence Pack: te whakarato i tētahi pūhera whakautu e tūāpapa ana ki ngā taunakitanga
Te Whakaaro Matatini me te Kaiwhakamahere
- Planner/DAG: he mahere ā-taahiraa me te whakaaroaro e tūāpapa ana ki te DAG (Directed Acyclic Graph) mō ngā pātai matatini
Te Hanganga Āpiha Kōmitimiti
- cip-5-agent Supervisor: te āpiha taumata tiketike e whakahaere ana, e whakarite ana i te tukanga rapu, whakaaroaro me te kōmitimiti katoa
3. Whakarāpopototanga me te Whakatauritenga o te Hanganga
Hei whakarāpopoto, ka whiwhi te Semantic DB i ngā momo raraunga maha (reo, kuputuhi, atahanga, ataata, me ērā atu), ā, kāore e whakarōpū ana i te mātauranga hei Chunk noa iho, engari ka hono hoki i ngā hononga ā-kaupapamaha i waenga i ngā raraunga (horopaki, arawhata, pūtake me te pānga, me ērā atu).
Nā runga i tēnei, kāore e rapu, e whakaaroaro pēnei i te RAG mā te whakamahi i ngā kupumatua, i te ōrite rānei, engari mā te whakamahi i ngā hononga ā-kaupapamaha, nā reira ka taea e AI te whakarato i ngā pārongo rapu me ngā whakautu tika ake.
Nā te mea ka penapenahia hei kauwhata mātauranga, hei whatunga ā-kaupapamaha hoki, he ngāwari ake te whakawhānui me te whakakī tonu.
Kua kitea e CLEVI ngā herenga o ngā pūnaha RAG i te wā o te hurihanga nui ki AI, ā, mā tētahi pātengi raraunga ā-kaupapamaha me ā mātou ake tauira AI e taea ai e mātou te whakautu tere atu ki ngā kiritaki me ngā raraunga tika ake, pono ake hoki.
Ka taea e te pūnaha AI a CLEVI te whakangao i ngā raraunga whai tikanga a ngā kiritaki, ahakoa te taiao, ahakoa te momo rohe.
Hei ngā rā kei te heke mai, ka whakapau kaha tonu a CLEVI ki te whakanui ake i te uara o ngā raraunga a ngā kiritaki me te whakarato i ngā wheako AI auaha.
Nau mai, kia wheako tahi tātou i te anamata hou o AI me CLEVI.
He pātai me te tono whakaaturanga: [email protected]
Copyright© 2025 Clevi Inc. All rights reserved.