From 604101c4e658e28da9064f7731df884f15e58716 Mon Sep 17 00:00:00 2001 From: Jesse Amarquaye <96346994+amarquaye@users.noreply.github.com> Date: Mon, 26 Feb 2024 02:51:47 +0000 Subject: [PATCH 1/7] Merging dev with master (#3) * Create devskim.yml * Create super-linter.yml * Update devskim.yml --- .github/workflows/devskim.yml | 34 ++++++++++++++++++++++++++++++ .github/workflows/super-linter.yml | 29 +++++++++++++++++++++++++ 2 files changed, 63 insertions(+) create mode 100644 .github/workflows/devskim.yml create mode 100644 .github/workflows/super-linter.yml diff --git a/.github/workflows/devskim.yml b/.github/workflows/devskim.yml new file mode 100644 index 0000000..2152574 --- /dev/null +++ b/.github/workflows/devskim.yml @@ -0,0 +1,34 @@ +# This workflow uses actions that are not certified by GitHub. +# They are provided by a third-party and are governed by +# separate terms of service, privacy policy, and support +# documentation. + +name: DevSkim + +on: + push: + branches: [ "master", "dev" ] + pull_request: + branches: [ "master", "dev" ] + schedule: + - cron: '35 3 * * 2' + +jobs: + lint: + name: DevSkim + runs-on: ubuntu-20.04 + permissions: + actions: read + contents: read + security-events: write + steps: + - name: Checkout code + uses: actions/checkout@v3 + + - name: Run DevSkim scanner + uses: microsoft/DevSkim-Action@v1 + + - name: Upload DevSkim scan results to GitHub Security tab + uses: github/codeql-action/upload-sarif@v2 + with: + sarif_file: devskim-results.sarif diff --git a/.github/workflows/super-linter.yml b/.github/workflows/super-linter.yml new file mode 100644 index 0000000..9eaf937 --- /dev/null +++ b/.github/workflows/super-linter.yml @@ -0,0 +1,29 @@ +# This workflow executes several linters on changed files based on languages used in your code base whenever +# you push a code or open a pull request. +# +# You can adjust the behavior by modifying this file. +# For more information, see: +# https://github.com/github/super-linter +name: Lint Code Base + +on: + push: + branches: [ "dev" ] + pull_request: + branches: [ "dev" ] +jobs: + run-lint: + runs-on: ubuntu-latest + steps: + - name: Checkout code + uses: actions/checkout@v3 + with: + # Full git history is needed to get a proper list of changed files within `super-linter` + fetch-depth: 0 + + - name: Lint Code Base + uses: github/super-linter@v4 + env: + VALIDATE_ALL_CODEBASE: false + DEFAULT_BRANCH: "master" + GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }} From 9bad16f3004764e4642a99308c6f1c587971cde6 Mon Sep 17 00:00:00 2001 From: Jesse Amarquaye <96346994+amarquaye@users.noreply.github.com> Date: Mon, 26 Feb 2024 16:28:20 +0000 Subject: [PATCH 2/7] Initial commit --- README.md | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index a172e75..d95d4d2 100644 --- a/README.md +++ b/README.md @@ -1,2 +1,17 @@ -# atlas -👁‍🗨Hallucination detector for Large Language Models. +# ATLAS + +Final year project by [Jesse Amarquaye](mailto:jesseamarquayelegendary@gmail.com "Send email") and Greatman Akomea, computer engineering students from [Ghana Communication Technology University](https://www.gctu.edu.gh "GCTU"). + +## Table Of Contents + +- [Introduction](#introduction) + - [Why work on hallucination in LLMs?](#why-work-on-hallucination-in-llms) + +## Introduction + +Atlas is a hallucination detector for Large Language Models. +Its main focus is on **generative text** as it is the most widely used medium of interacting with LLMs. + +### Why work on hallucination in LLMs? + +Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly *fluent* and *human-like text*. However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. This project aims to address this challenge by developing a software for **detecting** and **mitigating** hallucinations in LLMs. From abd3bd5a78ba3e8edbbf3f659e82a2b25b57ab59 Mon Sep 17 00:00:00 2001 From: Jesse Amarquaye <96346994+amarquaye@users.noreply.github.com> Date: Mon, 26 Feb 2024 17:32:56 +0000 Subject: [PATCH 3/7] Added flow diagram to readme --- docs/img/flow.png | Bin 0 -> 45253 bytes 1 file changed, 0 insertions(+), 0 deletions(-) create mode 100644 docs/img/flow.png diff --git a/docs/img/flow.png b/docs/img/flow.png new file mode 100644 index 0000000000000000000000000000000000000000..cba367ca411e050a4602e7a8af24858dcc500abe GIT binary patch literal 45253 zcmeFZ2{_gJ+Bc3QDwzqHLlRlWkSS9#B{HPU7P8DknTJ#;Gnu0lDM^+{84HPp$V@bt zhX!Nj|NS#m`|Q1+v!C-n&w0-KzUR93zFKSjzT^G9htK`Fzds=-HIzwrGVH{|!y{EW zu5bzuj{pn*4-yl>FC7B*-{2p7ms85e@NygXjpE_4j=C!9yV_ku+h8p5IECalK5+^u z!eWE zD@#5U^6UB_b{CbMO&zV(9V{#{(9YuGMk`U&k&TWP9veT1h^_Y#6tHsMn(db#v~4^$ zheru)^s{oav9NU6=)2j_)xiPdYUB9ZAI%-??Jdn+f78&^+1cU3Z=0bVFq?ba9Ly26 z@taP_58CFYnBV`ZXJg@Nz0vlF$ma5p*2gVvtgN?YMhR>_u`}Ijy!nHRwW)=}g^m8} zKdsBn*}(z2Dy|=iyd?&a-IiQ7`YHX%(;w@1wzS`z{O@#t^Fxl%-4x@txjAiDQ)kzW zUtL^1wzll-;AU@OiHJ#nQ|Qvi*u}ukWst9W9>@WNjI7)D{jrA|W7Tx^Kbn}d@ zehdx!+>{%9u)DY}*gqCBO6Ye|IqhQU46Ac;vvjrr)e{s@Q&az)kl-{O5s5fDJD6L# zzykiBpv+9oZLQWttLf&7v9U)w{|^aJa7$SK5&;VTPJoK`7Qd6%|F%+z{Yzyc@;jNx zxne*~1qEEpP3@6?oh@A)9qe5!;iD-cE&+3EOLJS~3EBbCJ{KFS^>z+u_+o8}!MK^* z*qgfAIN1MAwExbkC?vdTqyG|B6#bppe@5_2b#kZpb5rt$rJe`vc$U;^5}I z?r)(53Va#-CjhS6%5p2p2yOgkY4Mxj^?MKdi`2Iw)~^n9>o;dh45*g-W>na8;D6** zH)lBMU;{Ddrvn%NtpgX_`o1;9#(p+?!DfEMw7(fhNa(i%p|%#dHPD6-emBs%lULsI z{_BhUyMAA6LxjIX!;K$)350*BD=tXP{0CI%ht~YJR0xR>5Z^&*esuc>RA|#3{Xd~X zTMh>?GB{Det?&PQ6%yP+IzIu`@!vXX0Sil40HuHAw4JRT?9AN$0&dvQ%0F-t|2V)B z-U3{|xQ9OkSU9PJPX;%bcqK(`IRwI1pm9l$4>0Tlh4 zs0Wb|8RQr1{D~+KBl(|)savRYQ?Z1%oZR0N;y(kW3jQ8s$vfD)+Smh<-@p|1HuhHV z@fTQuc6LB=x<3N1|7y{R9QmzZ|JTayf6&t-zW5IU|KIc4e+)AI>j?3ue&AQIu;r3| zs|jASnJj7bfp)dI3q+H$2z{ zOEdVqf!sHKabD*Heq)duINuRW6v^13tHY1}8y@iA%fX3mIlO;`gWCdrzXXZjIs89_ zW4}-l>p1BTtnu%`@ISW3bsPRu$p6=@aWnG$YK>c}^zUMgTSl{KL?VBSxc^aW6xrgz z{`uA@w3+?E=Ip*sVQskLzmxO*i5vglQ=CnI^Q+>ZHX*>jsp5$KvlK`4FDeeC zV5SI(xTRl?NKU$r68|_!{efjSHC=3T!GD^I{!Mt<+TfqI-x9#)_@bMM$Dg+U8_V0; z_hx&@UpIF6Gn@VICAdPrhm4$pq8MNhj#)$EB5H+v+WN)C(G+;4U(mIvlN-WIAN$E# z@|inefSD4KgLXFdHm)|NKmj8IY_{AQQV9d(ilBhPR#9PNO4!cE9KW5{%z3NZ)=Hq^ zugm+JkO++O`UZaT&n~Xc4z`x^8*5XrcR+a6V^HP5{LN1=I}m7AkQ5@k&gM5A2S@mU z4^HBb69@;$vCznVgcPi8EG#VTq1{jHjP&}`IPl-d&V)7r+LjCc1IBC%BmGL={K(k0 zEZ`qW&V>FMl-ZX1`~iCnKwz5$+B#eD$K1t_xC?SbKL66||7YCYOw50EpIcez-*un= zWG?JS>a%r9e>tFTo%xnpY~@f}1O4;htH*0*G6TnI~ zE#)uR+Fw4^EpGDf@rOd2bX=l6M`29nhMIqmnau$E2D{8w1ZA0H*(rpj!2DhD*$1xgo) z=lF?k;KIOvMc6~rpQZ72WBlcQ!4@Xky1B6R{l~3_+OcPuaOnY0ML|yIqR~Vt*;Cy% zpW)|^&j$rtv);OL-*wy9s;iA6yFAJsRPue5>cMy>K;}Npr;S$Es}9-z_)IKY zVL%XUV0G^5hs~!*!(fBc1h;m#y?cHR?4Mvs`g7gHM^y1p<2mC3 z`?huhYem&F{9^(kBfc)|;@ufL$}=osn_i|F-sXYT~(psHH+Ox zt?MqRdGy7SneBFWTXoB~!XN_DKz1`KdVMZPmci62*5d5mRpte$3>I2t;;H15e|dTnM>P-DZuDOZcmU`h=IrCS|Crk zZQYt#-J_(bezgU%Oz*d`!)gnTCjMzCW4&bOR~2jhn6eYhxzc`3-qTr`%bx;Ryqmq> z*{-a*3@yosDJqN@Crr_38>tFNPo^BE&--wJXmO!qXndb`AH(-Gqv>*7>+@>r#HH^6 zqS4ou9MmYZy!Y2gn{v4nx5d(LEBC{BpR=udMKpA@()*o5==HTB+5Q*D{Ctxad>`|? z7*XEl(rH?DlYZnA!}RH(1#0ap$x}s{NA2p;5~m#07bNR*X@-_gZ(BRe!!>oa@tAh5 z$RJhbQ4y0KKT+c*)Zhv2fe8P8Va1_?;;;NHLYbNipA8!#$6!w`i+lEgJ7*?F_KYc= za#nJJWQQ=h+(C9VLhW7-mUq|mDN&qF4vABKyS-W7okXu`-0u~8GgnU5T4Wcp$}i!5 zLwrr>?e}j1dldGq74ocIz$IvT$vBJ!M^aHR&j+W|MXkw?$4?oFzm1*D3_e-Fl3m^x z`&@053vKzfd(AeKSl4GDBFIavxFU8*Ju%)SW?4UIL`a#j`q++MyaEm(bgw9vP%>5(=ll8O` z?lZIf$vcfj71@iYj#udhMN3msq}bJwXg7*krt&x^1s>H)oci+2ze&)F!k%F^mVYwX zv1NHOI5)UHS0ZK^h+XuV1#kzb7|a9CQq`>vX#Pn&8{-eNO!AisaBZ zsF?JS2IXD${QYNmKAui17wuo(rR{4{m!%%{sd_bpM~hr>GeCR~dWrcHh%Z{?|;Y?b%&NH0IUi_R@_7@Td^)p-wrZY3lblFRi)hH+qW$&J2*(;H&kn3k>;!CM`gZr5~kuQ$! zZ`6q1tX+fTV!H_qg(vO>FAp($=nc|kHH91AB`Y_13T1WKzRM(}^)zcup4cAE$ILm! z!~Ujm>AI)rwS=&Cbq;ilZgdIVs;c&?MS36~nlp)4OZ)YsIPQb1x6O)@6XMLPg0gpZ z8S#1*WV8D1K7RATQ57@MB%x(8^><$q+5JjtT~c|Lh{}qpU3$GeyQ;n*4p%r7&#X}E zbH!fb-Rvi?Bs|e3h@R53tK?<8t?;$3=HQaK&qD1v(Ss`dnL`ixQT_Ep99_hj>=(-x zjBa1HQPieIC36ct@VAtYy+eD}v`$7)@%Hn45)BqZoNvwYR|;(f))VI|W;07D4IZq; zEckT^b8CV$OIDkX8!q|D*sl)jsYQ*93TrD=b&Ee!F>7DVkYB|5&^)0>^;F|8?<631 zjDQ#gptfyop|JU{r6`A)t6PMN#5? zlwT%3%yP=9c%Y#U%@r~gx;Na{`{qFPA(zG&AzpS}_M8`Tgyt>g*9^Q;?s)7+UF%M8 zE$MDzkYBB!7LU4R$nO%J5Vn|~+z{NwA3m%HA<7H9;^&3k*H+jNTgu)aV$cxEk z%79)z=>EQUoDuuBaZ;$fj);r+z`2u`@y5V>{^R3SiQYN<#fkl*mH|Aa;Q@7mR+51! zbHdxY{JFF&X|Crdo{;ukQ`H_A5ug~K+OLS7^nM?3|3kcRRM&ns?pe=VV;q)m2 z*{k*+)^^4y?&~Q|a=wx6>&haPEc%+pX84en*@E@C@YHDT261e3)%(QkU}c!Ng{ zHGG(KCkRXxVk}K(OR`FdMMv&Ob2BmybP7p5mSyjXW?_1K)BkTo(5 z&rDQC^31Vx41vw%b16(JFEBaThqCC8f6hE=qbc+TrIg?>knR&w(;dNFOw(WQI)`+Hsmz4rRxtSvmrUT;GrSQu;(HixFcx`zfT zJ>`_()hrU;UWKusm@0=8NrMydT}(B2E|(skH!gZ@KZ^H}hxmyTr|>;fg?I_n35{lE z@Fh>nVe%q+LzzEtmUlFm$!G*f)n|%LYVco-)TW%EzVdXTo^#J!Vv*kw0hz8|uHtga zyKOEO8MjZdx8##dU`braD|5MbSilm54I4klxsr-YtA&fie0nlr-h{yqPf&lHevbg3 zxB#S3xFU_d@|p60JZ@*0u$aHfo-AU6F!F9{?!>i){zKnrOHJ!(qg(jvopcPUCs>kK z2S@V6*zGkar`h)n-g_{jZqRbpemHt&ySUW*!|GAe19b)-&sHc{J8DC}x1If%W2T$? zqSVWTIm#wz+0ys;JY7$c~uDWhu<~cVPZRZBjL2u+^!+U;=ZDVnsEi*{;XrfJ=}p8O&pt~; zZe>-(_-0^)H-x|5&Y1nIB{uGkVXcw?MQ~D?~>}doMK)Fc}9u zP5R55x4WN*$1A%j5K+4BA<58`b{Om*T@PFNCu^kkJMix!H4u_)a zd9x&s8`%~qi)N^llBJ}fs1SJfo*0(I5&lArST^0AAYVmQ6uT16lTV?hsSsJuVIiNC zk`r0L_R#$k3IU+9h5$!<#teoKjJ1JCkFxqF%vQWsqxbBmmBsS}iZc|IzZa|Mr(lK5+8O$%rchJYn;2Rk39fW`6e zH=34wRafc@Sl{#F_qBS@9-Y1-dlbJ4b4`!PtgyP#@;v$11c+(o!$NMvRe&%HFB-6- z4JXcK65&UHVoAA6YhQ)uk3>MF>icoD1ZB`@@uSTUNq{S1FfQ}cfCXPwPK^CaYtYsm zp#Q3b1mtm@f|i<3sF+eG1&?hctpFz zfa)e(;duuGtbEV`y$jzM8u@$^o(__gAW%TRb#l(9 zHEUNXG8G2AcL~xMPH>~0uxLIbGMGg&K3lHB9LyymwW*a&HYvc^7DkINPvj%?W&^QQ zzr|4zj1rS4s=s>u`b@9^_q!|2U}rW&NY==@4TMdkpL<#n_iP9?aT$-Wg&cN!h0=}n zJsENiK4A%Vk6jWO2#<2XSe*-MOa!R)scC;VH9WT^Wks({iD57MABIL{7n3}Wu`=Pa zV@HpO8|*@j-{}!xARr%+gG`Y!08s=O=<1iobNAa9&7m z92ww0ZRS2Z)>c^;$1ADrySgxZiAOs#Xzg%0qnQ0!$CspH7P8Uh=Q8CE-n*Xg5KmAZ z98nwmP|{t&zhcFd+Gwc_VJ`EZZAuKFoW~ zO^}QqUHjg3B%=h9 zSzI@f#!!RApipg!G+y1DBlTE!i@D2mM#LOXTF?WvQ6J`~4jJU{r^cGsTpyi@61&|~ zaQAY8U6OJhuoedb!BG&0&fo{kkvpEjg);VePd5mRJ@Z>zeZyOrH_3HEv6Wfc`zZ%{ zlK8M$q13LFM3BcMhkt@ynr0#e;Ue4nl7uJREb3BuirK67!;Pt_T^nizeX^|HS{ zWQPLULkKP1HW%n%~oKa`78YuxYh`@8gJ97`H?_V-KSu!xz8^naH zCeX9+qSWslnhlZfLu9m7bRqfI%dm4gO(9L#4>kh&lo%G=4WXS?0D|-l z8hm`>@5pr6`9w(wRXbq_-KSA1V87xpp-W%}J;2t0Ojw0zHB~3HZiUGWcevFA!4M}| zVfFxlQ6!BG2bC9(Hx)pdSAquTAb`{gtR}6rsTV|}iy(m)VQK^fA_$Y|JkU@58=*V2c7w^=n zxpy}-HxU5m#tW7v|>2#hXAPUE;A+)LM)7d z9FzM<5}XgY^-hqe_R#<)*b5W1b~|YWm>rK`JIqc?9Fq$o8-}Azb)hFhlx8m+U41C5 z&KrsJT}wDn8SCvZ1aEKcevo1c3?W|Gyc==e+R!igBgq7`9)rmrUXn0}U_gE#5;h>4 z;0jp(h%zWbO1;2dXkK9gN2d#``$4n85WFyi;RhuyP=f(bss@s9G@@Wh0K0mqHBEMa zMgU&JFtySnIxcjfYpQD>nb|eMI>FvfE&TjPD86V3h|s1YTTs?TvlA&GP!fB8T>sMCSmW40Vs^ zg0_2!p)DTaBFKD_k&OwCC!9jxYGNgcXE)qSsp;k48UKZ`wa5E?wH-6y8FnsyJv6{Le$ z>YLr5SLpBfywK)6$#K^?QdL~IV1Ep+;X|^$q{zD2V1~;kcc?(pas-rN=Pc^P)QaE9 zEurYwSGpTiyB;?9HO^nbs@$?pFQjhq8DWAL42|Gn(Th>yvgt<%oIfAbe2(}v`!zvH z;)}}Q*S?%>3}Sl|SD`$l5@uZ+$tHJWF>z=`f~wE-*Rr%w{x~>EJ;)P=LbLLy z2-?8XbYB)nYW-M{6CC|3rr-tg1K@B9P0}shuO{%t@cV%N=0f9VA9*H%WJO>DZI1jF z)KwU^y`zBl9aF#xopzW>6Yc~t^X;`xe8+~azoXg@^86JERAEF?cF}J~84@c=K>Xjw z4Hn%SkU$m?h&T|UGw2J!U4o-6u+{fqS~3ndqcHj0-`^%yT8931WKJ)KPnr|ysHl|9xOq}e(a$g^+*RPb%{* z>jS&6R##^^&zG1~2EPCN{L7x22o{!o60Qdl#9h#iU*A`nEY6IYvT!Je@3zx_a{jdA z^7n5hFn;B1hcV01#gU9l7_A;VL)}M4OgU$Z1q<}L=cz6$;b^fVquW6bAuPAst(i&@ zhH|~xi?Yqy7hG|+%-bUm-H`OYDuk-?#pPX>9vT)AnZF7r-9C|kG7scbz2RCGK^4q? zB4d)!NDL);zV)8mC^@@A1d}A~PF;!@)5A?o|8|yUP%cq-WTJ9P4qf8F05XBe;m3qjlb_Z&(79LJho5usb8@{I&XNitO92-32zO z#P&DbouUjV(%4Nz7Rn5iba?z0 zP_s4StRNQ_*GD)H5Mlua-fH27)l+;jKKv!`Q~0u;pJ6%`$$6WUyf zCN)n{?`N=8Hn4oDr-S?4U+x!4lEh`&;KXVsN+!|`?$8cNOp=uo$p{xYPKG2r z$%vb?A!1h=49O(v^vF3}I&*3wWQU5+!EhsrbHF`H9Mj3`w$8|+>on6n#VkB5`kJY9 zLj99c)jA%=BkV@h%biR}hS&lbuI=7~p|leg+G1zy`pcwxgE?Qg_dazpt&=^~m@|-c zp4nD-UPQv~`5JHTQ+C{=IOQIdzK6lq6s3%!7~+ga%_#;8sdq?f^;CrNw27jf(UVRQ z`@~x)KC+`R$;nW>%}NN4Pg0wP=;6>R@K|LyLH7@FJMC|Ai_ zY)yju1(UBb*nulA1Ta?Ekb&DlutIT92RCPR-tXb~(}8rEYfbiH34BQhRv;+xL*Rcl zB7(Uh>j8!|_?WN6stWVr_$WE3CPeObxhzvb!V~-7Lx(6+%X1uPUik)DhzJPgV4T>e zc1e~L`iaOkN$xijJuKc0L)x*!>BNX7?jl?SZ#kJ}Y6EHC0`;Qdq{lkQ~o)Z3NBezXzuG4=YwU{~{dtqjz zxf0tXEqQ!k?&{O0?ZI6i^;@XG*Yks~e_r;|nK)Li!WPBb(aS93dsI#24X^8<5-Oy< zo1#asVtAAa^#@1s^$ZTlzAG1J$K^jP*6}_fY&trv=D0H3aaFH}9ld0zUw{PVleAzw z1{R}q1oo8BCD#DUMU6!)m)U2g*#s1_61)Qi);`w~A<~W_tWH%k6t#IsF7lzp9QyW6 z^b{Sw2%}y?bcOoy6p%f|p7+*~D-x6$(uMXDGN@H}p_ZoV5AV><(jc{eHkv70HQAh@ zOo1ge%1c1n0{%k^_!xqRl-}e(-F3ZB*9$;ckb-~*bO+ju%XY=p1c<9Gdb13j*lGscAsHI+sZdpAWDnCuYuia0h>T9sDO(V z{WkhGGpqy+^NV`L7t66q!T|2*Cr<#>yG|U^@XR0>=HRT9W(|)Kx=0VI|36 zK0OoXhKK?tV1TZ~wsr!PA)_Y|93_JScq3LTlbwVNApIUZ?mHs*sN@^evtZJq2s_aA z97jsf1p{D(9z5J`Rwz2N8xjoRU=WvFV+A#_FkEXW#Md}(OJF9-$1{dlBt%U+?1e-| z!h9G2ZKZ3ts|sT`LXY4>a@g&qlmH%bYdrY0EhVy@unKeLR4ZhB-GKgk&|d__h%La7 z8ya&8f#Cb^9o+kj33clad-40`nOyb`K|b&fn6es#N%7`%j7t2@k~FoHx!kEoj0396 z-+vs0k?Tdi1VS$%Y)`tPs@8?6V;PtXaz_9$>&e5g#L{JY$U^R2^;fXeOmM!*^Cfvo zL}ea5jvfB|YyIhhQ`dw!Chg)n`1EaZ;9bm$x-{sSk}a8A#lQ z${jpy)dZYZPL>CQ-3#|uvTRCV(@dVS(e|~ddlN8)9pdF?)EOpI0>{MqMhsToPdo}u z9fK>(%pWMAISHP(QH$&8_3fZbaz^rmC}KXc^>L3NkT5ty0Fs;om;FP#PDx~GBS{+h z0i;gmU2`2Vt9bZWTvjQFJjjL>Yn$Gtgn3SZ7T%D!VFRbW3d*|p$rim6pEyMw?0ADU zI0ByQ)1E4C(A~q(w(M&&l8(u)faGVF@OFWcEy8Hy=1sMT$ajKY;UnZoMRE{`6cS@c zaENnCht@gU|C50KCjtNWO2GfkIVB2x4A=ASSV^_6^P!<#mxq>?)C^4PxYGOu^bj-7 z1?T+iv)lwwaQWnWO%Jk&4bI5Yo0qND#+qiHHL0`K?rUseb3@#mY`PH`ujhi01b9WM z05^2)qeSOio-YZ4y|H9!1`c(pZOJc#*PZ4Yq-G;CV-2;ar^jV8uq@c?GUjF62gh%V zJ%;rC>rFs;OPqLk#1~cG`wETssEIel&Z|eQL5smtCN019%0~(JODtXCL@OtLc^%gv zA1#VZaUMy^y6|_CflE}9z5V!_+QJo{q7L+SBnpCWF$Qnp^C1HTxJdv%q|vuN_7P>A zTj#X|AlEK}4;^2j!~@!fBGN_Aqg&m7e#Lz$zDo|sjFN1RVP~%00l9?If|}>|OfA}qss>Ekm+*R31 zSjYBld|1gUOrq;31RO_%N2k#=@!MG2gG)}I zYPO5@I?A)UxqskjFd>!V z6cvEYj*br(9^PLk={DB-Rrzg}CfTcKRK{eQ-|B)%T`W&!vO^iYJ^yXg3L7uvsLNIBwko8#i$QU&i}D3={@lM5OR+`j7= z#X%m@x$jdeA6{OSH_bWbhGeGaoIbtYD`eHU`v(8H?#FALkIhXFR+afIN%*`@sE=0t~8h7Fj!cex8*Am*Ox6!0fqI`xDt%wv2yasXIA6sd$ zDjrX?P!GNfM@v9;Dm)=v-nJ;d|3M_JDQ0-K+pKUe-AVyn6{cBX6wsn$6lj3rBU2&5 zIt~~xZX`=Vl#KakXJX>YW4}|46ZMD7dsV0+uSDBENPcyDl*EZ;vgcDDLL=-ytxdQ8 z;Dabrkva|4yjL+_IA1)-rf60_?_PH)lZE=ju__D&^(Zj7jsQd3-N?*j2tzqx3Yy2< z5kt@G<_rD9sIaH>*ozNJEQJ-EKVKQmsrq7HhqZ<7wB@IoaZYrbqKfE{8`~dcRVRxR z!a@~N1B2_g?bs94eCoAcSSGzfbxv!4o~iuaM4!>S@e&^Qo2iK=ja^J9!_ZTb4PB?5 z9u_~%FIIDQIF0N6V- zfa?`wIpGNpW2DW&9sQ)%8xWGZl57rTp(1vpI`J}mG1v_>yD;SDg--mHti-J+VARqX+7ti;c%<*x{ zF|w1ybmo0s))!ZvyLFX$=cDo`J)IqIyE{IdFm@IXJQ{Iysy5x$;ZqI0xUk(BFGM(cw<-=&Md`%OA!}}RHfuEU!DT~YWoL8!ZVtf z^0{tXc@%H_f#W??+!};imRnoBojqu{Un~0oRMSg@)o|gFD}5s_%N$+Vi4{*~3CwHJ)Fpp4lt+d_=1r)O4uE`Caxhp+ zq}n4I&{Cb#H+NS{mnP6GXjvooVd>)7gB>Bb{okyM5|222OgDUrG3B}4QD&(Y^c9>$ z6D3wcVcL2*p%yCT z$zgO)*xtAk+`VQ%<3w=kcFrP2N#GNi%=p^OJCq}*vE4PaaR>bmKcC2#3v8pk!H%~3 zcF#=rE&lCK3XjrH_e{hRtt6&qvdY91;D;Qo=ZLaYafmF~ZkSgmQo<0WgezR(tX>9) zoDbPoJ(t=V)SzVt%?kAjw7+J5Kbvo%a=>3C$<`0o&nuX`A8j{36WXbCjy~+Y5(ier zOt*zO824=UMa3CV(PB{1hFQ`Za!{3u3o!^e-Yt%0Af<6)q{%#`$=r|__l2`u$6533 z5UwVqYy45U@5vdRS0O{Vu^PeG!%yDszHO%4?a-Nb%gRD`_+XT&GkRQq2q_X3gn;&{ z_gV0hkEF@oHPgk#3FAvO$ZGEvW{|XP&v8_0hU=3hckL#q2%e>)BdHT<@EMqtg9?>= zL`d2Bt69%ywZ`3hKkkB|3F5#R=mr)i$dO~K9q+*P;R-vLy=dj? zEct;XSsOFm@P_<|`(v-Z`f7^gMZC+8*f#!(%g%7%s8`pegh|EVe(({}NaFO~a)>x! zhOmSj>)cg2HCTU1#I`+1ui@DuEBf5*K6hxQh}6tfV#-+GO9vdQ%IUlQ1PBp?4E~^Q z%&n0^%z=&JQr}5?*l3>`T=gj7u?1q7?FpUHMYcDpgfr2E#b;%im&~>o@0W9EXnEjx zcXD}Q`sJ#{zDea*h1(z4C3mx$Bi4K5;#ZSbMm8KPCkE!efBRH9@H*zD;j7lnd*>KF zgejqCPZ80N-+z$1^9mUY^T?Buxj{1bpd+K~AtO`AaL?8P&56Lru7S3#2;JEM>LJ?? zSDFb}%|3&X1)OE#4Rji9xf@_a=QYv!7@K>SNzxsYXWe{THt6Qr`TLWDUNoU_VP^OC z++YKb8TZ4*T<+jSZdubtVT?6xB~=I?w#Ottt70DIJs;mYbeG*gv1pFtnBJ?nw0CYD z=PFagU0xX5N?ax$A8~u`%#<5ykj+cb#jM<2HOt6k+|7>enQ1ZShXo>Nwq(G1M}Rx! zh#`(^@OoX->CO-VZ1sD91A!3bT-nnWpFgqfAgaH?x9f6du&j@cfNIcOmsJ`m!tZ77 z>SPzuShn$cev?o7E?JKT#SQi(MQY`@6quz+>xWWnSvNfoQctm04Z@XwGk1V2xBLqy zA6MtRbLe%J#}!U1*5-g+V?a(_7qu7(?6}_)CD26CapPsMiycH;!R?jchj)mNet&b;9 zow-LGF;0i-nTuzh26|-*^k;}uS(3OQ1`egr(4t+s0bVniB+k68F7c#dwfGLn{?urb ztOK2&>nIc3B9@;ks>Do;(j=-=VoQe}m2(UBG}5tQfnLZ5f(rdf(T=zv6-Lq()3*^m zO?dYXIWARFOuxwf95-hLEmk>#nJG4qHR@bLR@}0FnEm;k6)W@oEO6`@F}|#`ufiDV z)Bw9h=JByxiK^hbj~P^9Zl-h{K`phY9(FrLHR1a@(QZjKVgaZH4=}~)=nN*pZk2Qg z6tDh7#9~Gky|u5c@NlbiLxuF^3TZ0c#c;`nitvKay{)mAg@K=^{4~+_c6W3YrZxAe z@U~HTZ6XVeQyQrfZC!Y@+-SFLy-3N1CUd2RPmCQq=}jRBgBm`qO;Aq4>r|M4qm$NHSHl@QbEuZ5Dk3HRA8$yVMC#u> z`t_sKD8oH^o^ZFV7g##CdSm@vn@;_#$=Z)1`;V8iVi9Mwv)x%j5qINdoDpPTMSxY_ zP0_U@7q`KGFA3vG#tV;Px{Rp4xY_DInp<4DlU&+TSk%-Nw~Icyu|mDaxX3fOi~T?g zRI%SnfR`I*uJQ$BlrD(kePzRETy|6+i*87NU^Y&RUHPc?O!#)c@274Kbbb1XG}wVH zXlAa*ZZEcz`~fejF}?J;g4>H1-PTrDDuYO<0!zK-i9C6LD?&h7_+~XeoHW&q%`hMIMb8z)nJa5Irj@ zP`ppJ>VXfo1MX^F+P;f6h~;HZkzsa1oQfT!P2^7EeyhtTzt&+LKfEv*Z+~dYSb9!v zyo+6@W`YZy@oAjTEdHE(7b_~cZBKE7n)a><;cW}PL%77sxyhbw6k`WX;tv^6`m%^= z^gc8$#D?H#i)Ti60m6o>!tJMeFgIzWqNOFOu8B_oJ48fe&IgcopNMAp52J3GZ?eI^|wH1$MB6c!UPV z{^gPxjD5P2i$bTkyNx!pvc%n5(kVCg9MjCAlyqX z+%pPF3;mQ6)%CO>$SA5S$9({~CilQ_;5y{G1+b#RbE_7jV++kd0ik3=dNPxsRo4WU=8d08X@WS0_Ad1ya(mXvba_f(C>szajJN%%wlV2;|s3#iXe5NUQ*y$AK`|y>Nl+ zZhUU=K}^n!X6Y~a_v8r3j^o}0MiKzD%hfa0~!+(h`aT{E>iL1CDU_G%gH13s&VUtLvVVgxn z0avKZ3h8|-b^`d5AOJ$yzHWPaq@Pt8i@Ix}1h)W?w|D`!!K++jSCIjO=Oxr-l!vzf zfaOkfzQseC`p%+`DOZg^a-IHp&kg<{hY;WmHvvPOlsT7AcPwzvaE)Y7Y?_F%cvnRh zP32i=It)@uy}*Xt(ibGx$Bdn@&}GjvRF86T8}xC!#WSCn|AIQ?%@iPXn3Dqr4L`C| z2-2%l#P<^T?z%{ThlF)a!6@}sIAVy@F7PpVobeEHBP?eMizN)%$*&wbys1tS;V=mfQy`Kie!ddcb@o{ zYk1=~Sso)rIy~|9xB4p#e_p{e+^L4VZSVgHUTj$>x#1!yRpiJ-k=nvRt*+kPHW2ZU zSF)gPd(Iyp+_ySm+4pPZ->=QDH1scrrHC&bR~HpHv|e_cforop+_Fg!&NL{We$q}` zY|VEYZ$Ec&X|gEI6K)c8BpKA+B{{k-miK$XE1U0mc@~D3AxQgP#l1Qsl(vAQyLs_r z$TgXT*P28QCEt`B8$>!%yn#MQTka`e={Y>#A^C7UfTf>@HQf&pg3|j*x&X~^29dGX zhrK`S`c%I3?u*f0k&nE_3w7DtY2H(BLa4aQOnkYynKoWX^WO$1vgZg16-22r5;X>C z@9$I>dYxWztE)^*lr4SUrRMP|^+I29jgIHzFIq^&6^ZXqz~*B@Z38KbP<_8mzt)7K z^8R*h%5Hu*N|~9YZ07D^70v}R#+RP>pXQMcztl8hPq6lm%$9!f`SL;~hU+f#NHv}D zZr`OMzvM8}><}&Fl{Hx(SkvrdD+`c@0zq?_k-=3nbA4U2R)Bb{Cy@e-R4+Y(ULs^W zkcXB(AM(M&CnfZ7&GJCJ?0tBsZu0XX6FhXwp(j~?n29_z{rM1~BSli^x353UMIQb# zr!+iVxK0n`?tv)Ta>mm9q?($%oT__JqmfNN3$k}!Xn_maCz%6|iFsOz#Dtj|glMrK zTM>t?3_9M0iWIcFiW zEAoRCt$fP>dI*vqC0LP!;?GGJNcM+xeH%`3X`E2yFCKVyq0eJDf4&phDRz5cbd(;g*$`Zi%GV* z^v@yDG9~V0Kc}T`{PAm#{qxBgD$S!#GYw+>%j!a75%=j6wOCK?3&?bU&1-LN9(c4= zZHDgi5*jVyOeou+39>NqXUmO}Uvg^Lm3YD`O6U6+6J(AXp#tZycS(=EB0q4`UmFo^ z+NNmXyoRakv5kGVCAg`vl+NX!pN*samU{Y`b+eqVpW7F}2qrvZ9wAkj9DC_wLW_1b zVG3*~j(AfaLfQNqd9Ikpcs_Ou5AOO#ch<3z%*bo<$+QZeb#(F~R`J-kcq7kIFRR9s zg_O|{b<>p(cif5zQ~E~YXh=85fJ@Geql~805_xWo%9yjyyvTn*@fZMX^-$OZDc6yc0&wH&YYop5+(FeuURu*RQIT?s;gEhF>r*H) zUi$Xw6&Zu!L~NQvPaz+W=nBJLF=E=;VTxphp0i^ngLQG0>SFJxH)@sz7v=z9TOWR7 ztU+L8KT}s1x+#W@>m$zCQ~apso0&NiewVt=jgV@wpS4T@I7V!hmslfQc-CX{$zprI zr1VJm`h>)$L`IPCK^66!W+w%fJ)f5E3^neil;r-$=iBaAU=Hl!(!9A(iOd+eSUc95 z{o#x7?F0R)$p~F>5h2KqKT^6Na$mxxx+=d>fEZP-fwhEVGk;dxs@;hsKdn@5!>3LsIM4LU}^)7)uxN z>TB|(-#1gQzhYrn!VX(I*tq`;FUx3CnoKzdzX+dP)xDkhDDxWEs*xxTZs`frN^ps9AaF!Q5*Wf^Ln;7#W6--JB1#;oV5%%7&W^jHNrj zLd4qXf1HloB*W`Lhb%veF<$6_mNJD8dyR1SUYdZ#rS(g;aAUOn^^>?Y7I^hh!0BUE zctz}4eaW5YvuG_Su$d?0DB? z(Ay^+Mm-_^9B9LpXPB1*og=5y>ALpn!s{+mad=T(v|iHj3F?$)FL*R&y3Dk+iAC*u z_l6os)>&UOcvr&7(m}_Do`gTPfxHZP=`1E|=L{v5U3XI5DM`r*i1U-U6ZbEz96xwD z*sX_oXKXT5Q}jw4UL3ywuCgS+e zBJ)p@(=w*X19&urndI!kGFdu(dbs%%H1${odp_zV@6a~S&@0wJo9h>QkCwK9rSZ8t zj6(UQF()r|&Ki|JYa=i7l^jP`o;&@a3>4}ITT=%{^ zKBp{nIUWz-3csK3Xw0_k8?hYj?ol2e<)(NSzKC68^&X7VBeHA61s3(N+^|`E{PyP5 zP(c`LE_*p^OFmeV3lP$fIU^|=6Vq1e7K z+C_Wt@r9)<3hZLUtNHS^6*>635XR5Q2fd)8)0h%>-1=;RzNTTYD(X%3U8|B4Ogvc{ zsXIBalwoZ;+r284H93QCwx`c2&^fg55I5hm>sD+c%7e?5@iDRh7u4a^o#7rE-HyjW zW_XM*7iXC#r8pwb;O_fI3Ljs|IJ25sq|G&*r#gMr^QN!ObWF^x^Tqgw9tpg(*|>X{ zp?IF4Sj_V-1-5x4cwc>%$JpYIM@s09+;fbF3=4B&uCmZ1xf?GkKk&H~I>X^-QpdrV zJHfH`aUz(R?0f1LZ*HhDDqDF=#`mpq7_25}FmQ{^283=n6K1O8eCSU>wmMh~AD{A> z7S+`Bc)~({DBFFd;`Hf{){YgAUMKQh zpnCejDSN8(D#1)rR%_9vn}U8Tt`ZH^CtH|N}lCnQ+pJKi0b0$6? zbqKCldT6l5B|Mq`vj47xB1e&palexd(Lr>zm?wX^&vmPoq1l30p-S`nHc4Lfr_>XS zI&Gp9U2`Ei&t#6TUDV7M8vU*|ayMM+<_ek4Oqk>-OY+fO!5d0Xg($rbk#DT#%+ZyCM_=sCbgNz9 z&)*E`Yxx`w{j7eX4nI7T^SIYids~kC`a)DHkGu5w6}g2b%)UQ;9r^nZZEC0vrAH-Z zbMSUAv+K9x?X{RwXO0!sVtV7+oN+gO@J~=gb=`UJ_?jaJ6`w zytuBtq8A5|^;X!HKNY(@<#h&g+AAGH9TTSI&Y;`!_;$0$2+y_`2R?V|EX|!7)n0w?H}#rZGK)W!4Q+Yz zylU^!w}(=dvgq$UO%b*^m3Q&mM>*xe{o=QiFMZl4gIuL3Fhbr+g;Rk``>OW_yN4eHkK^k-art+aNGad&k@*m+EIOkW3v z@@#f*R2RFbXWQc;`e|;$&b@PQ<5<5~dWHrmB+c}b8(y?95VJ9gu^HPRW>X#^1>}9A z%&8l`QdHQi9r}F^WhWfD4xSeZ={jT^@T{8h_%qWdJqN<*u#}d?0G}n|sjR;natOG8 zKPPQ;-H77>3(4`-RG;0KSI}h8>jGjyhw|`x~_`>gN<&Kw^uFhsC&MLGpY6@Ewc3fmPfy-M|I}H}b`!3hB5LHc7 zZ)4Y$4qd3A4y!7&FJnn9FoQpAw`6{9R6ar{R0-`+zB2b!*5e&p67^{NyRkWbr+1?l z;o6XFE^X_!yBW{<2e+rMHhV_rJc^1RdBts(p)@qP?ZIS(Y3wzr8`q~lv8+AC*36)f zc&$#AuDFb9Gnd+EtQt45(-=-}Tg=#DFfJZ6rQ%;!YxlW%+k)lp(Jz}7Z~jMDp-ciP z?CB}{T2?8N?`0^p{`!I0sccQ3gT1XC<30x%(rc%r(*r1%+<24SU3WYyiwOC2dq>T9 zro0bJ%u%Ix6I2%#uFkMkCZ(+{q>)Y6&8}3Hyt43_oIk5f`pB`jb3PlNv0ud4uZB8A z`k~n1E2Rd}UT<8zYWg>`_P$8VT`eP8d*+k{qjzL^xD>vKcs_ZoLhYFrAxLqWlozPAyJ2%Pe zDdN-{cX@7)=3_0gC$v2ieik1wdDDU{o+G#33|R}7u4deyyO)|&A_Le@BfpGqMkMP5 zChx+#o~x_lQHN|g+BoCSI=6VAa{9K7tcqy-t-E|F5#`g_cEiCZu2T<-`l4m*OFail z)r>R^i|k4Fr=8goUNrqMBkgH5)8LI+A6YzG|Ej*nc5BZw{93zr)YNldp1MbxgeI37 z*Pd+li=QA>X^|ecE$7_DzWAlPKha}_R~yZSHvIS@!A95!*B#X|Qd!k3?;g|V{W1Je zu%!Jlg=3GtVWQev3j*(@?WoGRL$@3-azK0aIgk8~v00i#8VbgF=xo@b=WWbuEVtPuiCJoB>vTA#^o;@T}9keU8i(9-T5@(n;3mrImMv$_=4sI8_o zvlJU#&20L9slju|2$OBTdJ4at%KUK=796kak);*NWb^s$a`Xzk^_+gJc|bieQPO-< zcXh+`JIGa%AclFs{v+1gwthKbfH@HU@lfCJ*!6{`qs1Vv)UNqNvg1w8^#;$_O*^2b zQT`NhabKx7Iii`i`1$hn6eUwDgH7@%aCu^1lzw=Y)Y~2?%3Y-)q-#+tNW+$@2Y*fpdpUMTv zI>BD@bd?SI40R{lOykuPcy=eB$qtlYJz;2CEo8v5O!|C-&whz2FCk&lKa~PH!?cOsK@d`U&Eah3Z;|oQ7Af%X z$aEOtk&}bQh$Ysro+JrkT3VUg!ZFluGQ~bcOnvOfBVh8P=_56nj*{Q1SxLLW72)Gw zq7Ij-NsrUhQP%l!K$Zh#`WTgc@x&5qjt+5O$%bN+Ct!6dfJ?-EpIYfLuQ=Ii*BcL} zqVqNY1Su1HYeLepE0ZE^aG)T3_LTEPHT%qAS(M#=>tj7r2F&Q)bQlb;0(JOOn_S5TwE?$kp^`1)$Q&8CJovev|Q zokGaX6}g9+?!wP$*CYMOtP3SgmYcRH@~kL(aqP>@?1&)Jim+*~-6O~w2kU!vXO*WXmEOY4YQrgrf z$#3(08zM!yHB|K$cHLE;JtxBN%FW<&Og3m?@?Se7D1!Z4oin-Iu4^;RBpZ})w` z-CQE>(&wZb*X3kg*AVuLR$SNk7`04-$ih}wWEi_~Uq@=G^X!S`ds14_9Ahe6~aD^Y0f{(N(gH7SWR&n?aXsP87Mx)4=GXS9ovu>GRpCpr_F((*4pgrHq|oUXTj6X>u}v~7HJCMgon zn@JuVCZ^ut*G5^dT3i#GHKW!pEBtcT7R7_B_?V?LwaN1rJX`A~ZM*e$_2@2nVS7oQ zH*Q$YQN(J`E%LKCKJCHIi8yY!a#$X6YApg_8a-@L#8{6HdW9eHYzg()nnxAy4V_6m z+pg@QTGwN=wTr8rP!KWE+<5GL`YI`~U}8(|emW-3h}WZq)oyEmREbw4;M67iDSboz zT~hq9Ml?SIq5tKMe9lWt`t~%kbbKsLkvyNkcs_(cJZ9q!iz6&(2qI(X9aTaRvjBhMeBu zE!L?!<7`~Tx2+@>)Hi)3vskeCigJRb=etWNOAF!-kaE*W*3n)dLxSP19Q$iI1hrIB(`}uBD&O>Z zv9Tu~8~IJvL!0r;H2%zqc5$rZmx1mibU_BZDN}cicSs*z1p6Ev9IbQkgVZ&jsph-W!1XKAakIX!KuJfv;&zn}g2+ zInF-m@_D>ia>5Fn7o><`;w#{l97g=$eU-3m?FAic@GJMbIyZks)E--oLWyiHv6&v>7~ct=|{#ZMZxy!r;8 zg7136X{#`)3=@gaH}P0Mvky(SmLZQb)m$lyJ|yDUjSLGqxUL#1NKp-&US!{G!pthE zrM#rgPSB|wcXDK|A%^>a*2+;DFg8Y#l-F_^M*mG5btc&N$P(4cg2wfjvW+pG09zBj zwO~q=hwd74F{Nv>enJ$*_s)>{;!>@jKWR~BrOz&($uIY=H^NwW#5_AO%D{Z!DnQ+l zVtxpj1CJZMt8E%oel>wo6?jDT`ivm`@a#;9D@aW|k=d8*u-3o>{7w?fPBI#mo=%Ph z3(zh8DDDM++&Fd^UQOZ_7h!<{fIY@YMI{Z*Mgg_T5nSu{Mb{f_7!Z4+F&j^BB1T$- z45sNlzLl{d8w%M1eAE!BiLQ6$WB{&$1 za8bMn0*hdSK zUl4Kj(8$B$$rZl9gRkH->)=XM-ldMr%r_F%;-vWC5_sdAG;*4i@Se)+u1ZDlfek=7 zZgZNwLG|R0^>kICQ(ajaBbi&f(mqc>POxPRrAL~Ss?7f6_f_qeIb>D8Njk^G(ZMlM z4dLW!JOuZS2KqdFR~fX5)#+gRZ$?QQWw|ZFnA0<{DcYXZMMoI0(5PPh%a?V^yJ|8{ zrnSs}i!(Kok`0f!wX=f#>C~#mZ;xyV8~`-24x2!Sgt5L9(!zx7Kj^BxFnu200t_=w z*QxVI8AsbAK!OuuJ-2uQKrbG9^Y3r_Y=vu>en7$vD_bT?cn>6>@LfI|h3~%s=V}j> z!CWVr4L(^134p>dujB7U17zR;^kN6Z`^M9~%nPsMY%cL!%nSgqUTjz|^X$0mc{nA9 z4dcMcp;<(Aa`1WNK4(z(6TN~tBzRTS+TwPRQy@rp2_At=NvR=!K1SMv3Rs_+{W`*K zw_LPh5X@eD4Wgb;M&PB00d%5)?R9YMIn@_>PP?OqzM6JehV?~I0(q;;(Eig^kyo45 z69dd&-U;1E975$L8l220bDImB!(0l4xJ{YZ7#6=k9jLay%AK1>EV{xoCn30jfYLpS zpYa}^<{b-o9M-m+Z5j)nWXodU&c6B{k*|2ty#?sxbF-p*9JuJJ=myrH1Gn+0(GLhk zSH{|!kg7K6#G%^m4EaknAk_sjR>zVJ3coe>;oD6|Sh_XVv|2USCc{-3{50*LuD_Lk z(+rWhA2B~ho2rux3?O4=W)OZ+j|eQG^$}857-j9I$km zMH{m|IZ;&GliBJ=4}&ug)kGLu@9)B;xGw;&dxfW)%w0itM6f0a9~G~1icRgc(+Khm zlw1H7xyPiCL`Y-3M^l~`A)r}y1V8=NwXgv2aWWuKZe>R6sNj1_v&4(C@Ɂmx9Z zuMl=ifwT~wu1&+w1oZ zy?w|lN!1e&9HO}H@`~dTm zacKW?_--~_P9VYiZxUg2geW~f7zS%9@ufn=J4i&F&T`~7NV;D2leU2-f`r}tI+W+_ z0Rf@}2x_%Tp+`*K>6CtWJMjiYt^T(x$0@DKIy8u5#846oz~4ctjxZGVI>-!DVHV9p z_arbt`D7SGt?#3Ljsal>q0q?ZvFvoC6e119fqarKll}<+Iu$Xf{Dl6bu_o6Ev8kg0 zXOT~c^(8=F^fRmULVx02`1KrM9ex9*(R%rIvLNQP+`A!Ys4v&KjDd!%s4jrk&3u#n z0Z2~Q>4vtUdn(^S?bHFmvGu^r3c&E`mZ6!r>_UJdz#jjnte4+?+!xcJ+vWH5+nz)C zfIrd}v_jxl{mjuXP47@NrEEWa0I8M{0w|oBBKSiy;c5dk4b2ZQen8X=2)bxPWhM-I zqXj?$pmQdlz|a0e1BNC#O0H-L22zxuBNsXFxE zFnaZ`D`(0NfprIdwaql6r8UN$)kY)q#W8bg;F{1x9 z*uQ4v|7kEULPQw;_b+*~#=V+q!dy~6nug*o$;){uXaB?8f;hivU@~{uyA%b5R63K& zMYzn8SZ*hAO~=(bRb&G==ih1f7463a5A}bQ4xQcVsm*hm)v-_~eVC7XY;}0$e|Raw zB4B#1Zgf3RGDjXsnmMuGy_B;1#;M+~rYEqJxX&7>}(S^wirm%iT$)b@v` zK#2;CtPjVx@&El60N&#N8+f7|S@F%1#t$e?RUFnOK&rEswlN~QW1_@XcQmeRcXk5O*GsSm8KgwdKfd~f zB6zaXdiEm@!%;?ONh|M}fS;2>6gBBQDlPUNEUKEUAjeYPEU3)t9Yuw5O?^YynWkLz<3v@G!Aw z_|j2S@Xj>iCslBSsWjngSSz!_dJD⋘RYuR|8`~#HiVJwb-2eGN_8?VltQ?((kE1 zx)-1!a|s2>wBv8mz)pIr$4E1wt<143KaMG#vVHO0H)-zc&vr=O*Voq$L?gB%0h5~L z8!!)d+|%2mJ6LMoglmghSl&!5I2VF;D^(EK8Vyhc+C#OSge@T;2qx-in}Dr;Eicu- zKb0R_B8U`adC<7sOz}Xc>RytNrz?k9Z=4vypvl99!*;fAC=%kGO*VPDvGC=HrMr5i z4+6GL08ksg3dDq;j-I`H^w}FQyFSgiEl`G2KIVI?JRL~{N$L#Jqkj-v)XfW5PTEua zvC?AKTb}&6lOu{0OATVrFxUgdd|Fm?H9!!*RC8Nw1xWuFGwmf6x_@QNTCGd^s_6(3 z^%cW7=-N25#`mN6mTTA}82Uw(UL7|*pj3lY48bbT44xH1TvoGsm-nT51wf(R?#`w~!B}EtwyHs)Cy<@vcvfVh-<;^-I(D!+oPDY89Dq%5 zgIr?0J)%6eCVPsQNdf0@YmValexXRnY)XV1#J+p%!!YUeR=9aDeH-(!>jq9)-M7$1 zh~m3>lj=mK6KEfqplTCABJ!u9didlkbX54815AM77X4dsY@ilK&L1Wk5C_%X77mRaM@d!Jozd*$D1P z4q5PX()ag2E4|(Ul5meUb4AwVC077}P=c1FW|jW?7GSbKpY!NMC6ErmPVPfE3;3b* zz0l=)z`Jb|Ebb<01c)`#=`*1I6l9|RCg)VCtLk`CRfFhkBvZOB`>bP%1>PYATV8n? zR5N=1eWQ95a4M-<8j?M3`nCPI9jhQXj4`~x-*Q{bvy{bg_sSpb8lGs;5-^F0H5^qP zR?bSUIZg}BaAQg5o)|{s7aAFc=gWpST7>tI++PO)w-s>1EJ~zxR)7mX^<~Osn?(Nw zRIU8ts81KM{i+Os76ODi+A%-8L+8tA=K@6MjF$x0+*}{|2}L4RXXGh$_hq_1kadP= zpM9r$6ve|w3#0g5)RyxIH=H-%Vkj;upXZy0njKV5q1TFKMg9Fj=n#xdQ~4 z_yW&sSZ+G>?|MzB3!C+Rd=OCpBtt+zUM7ADPw~THCVG3*LE$C>lBJ_B-Cb2R*gYuB z&$vck8?$}?n`V2-Qh9GIUq1~ySFvF2NR$_K|4Q|*o^1v#P0XrrHunkw;onB~eQdR_ z1)IR$mrE-hA#LO0q)h}43__1i3x5UHfD;`T$YRJ zTe6QA0sRINE(0ZS57B-4!_^yJM4^C5|1`{kA&)mocqfggKZO?}C*vyGgL`M&Q( z&DU+ib%c*IoekfY_$%}T!Nt*n6}QkiXI^X@>EdG=@R@q|#7V#-o5rd#Eqi&?<~I=! zA*eQ3@~FWI0&jJC&tfuu^`Wup8_cE8n1bAg5$K(Ib|=5F^AsMwd)NT_3yk+iu(y8X z`laS5f)3qrePS?WS4`|Xd~~0?H_k^@#m5<;k!x*eh=2*@W^VpM~>Q9$m;^vSd$U}tOcVASvZO<>R1C*uRsDhSF~ zhDqw}i2M49hfw`rMYDPsFf<*S=|BT5~+ z5b&-oh#<&RzG=BH5gSnSarejBNqP@U^<6zH?SP`gd(lK0%)OCZ`L^R6G8tP*;;&5r zl|OLs@sUWX+w3yYE(!>Orgg|~4(m2A5nxqgbM~#@L9fR>&9Y>Xanw&~44TJ3O1dA@ zx%0TG_!(5{1r0NlCR!V*l*-3;OA}N=lh|0--W)?G3ZuKmn_{sr|3wj5BsxY>w;{YS z)5!3-*rX=))fk^+df9$1kr@hB0RZ`~uM6ROiIPb+!`4ysdxG|hqAMr!ww5Hrt|qmi z+RHB&b{P*givzyfvaMI+1S1dW+P8)1cC@)Ce5`sO#yv5gx^+kfm66+w>B{niyltKs z9JFWCshnSQzoifHR~o(ktt@Mk31&lN?h{^4g($a+_l8)i=W?UySy|8Cyz^4`fr81~ zS*Wao&Dae9LvyfsOT{0V{^(uJ6bt?d!Xm~0RL@$KlfuocR1zL53DS!5Ev{Fh(_1k| zmsHg{&Fxa^JDT!3E?)NDR(v~#MRmEoy%!=%YockrPMTcplgP(4qo~eQS&^NhN?Sm^ z2l%1IRxkMa>kb7Vkx}ax0xwN@{EP24glMk?bX&`^X4=9Tb_n`&T1(mf(|oR`S@f=g5WAx=<(F3zd6EqpQZ9a^lLc} z@mT@afs!1iN%tCwpk7%~5qE1&PXLk}G6=a2P+Sdy3TlKoc8;(n&j_xs-*6PT^x=KC z>Q~~0slROy6*<{~j9P!PgV*zW^;FlKyPQlF)$# z>seQg+E3^(_!R*11pFoEuP^OPs~Qq@9exBL?px`HCHYVVTAP$~kh{NI)uuAd=ak7j{^0mwD^7Mf$@mwO-6sQB;QBMTEdBuatxs ze9B9~IW^_p(o|y_=Q-a_c9=-oEmxQ_=`H4+`cwh=wT{#~LQX3gf;URF2+iWGprkWg z%XVuG)<}oDG&GNer6kXFB5Ha&@M}|dx${n$)%Fi7$Q4aM9T-rnkocY?vLWK#+&DdK zX44Rs7~&hOeOzbgXuj@k%ZGK!t#-cBfNuV$K`Iaih9hYTLB_`%T6SzzeQ4h0S&PUMW73Iq4DeY zb)c>(`VPXsCU_DdN)6T(ZlK?MJ7?PaP%BuRuEOvRVI_fv0J{VzY3hk{}De!$~(;uf{%d+|z;M zv7V%7LfBLw`p`7G!GktH$aZ$vcvv1Ee34}s0WAlyS+Cp$gEPzYoSDI0`{#A`#sWSe zHNAI7_0mLNjHga;5pOCkYAKM^Yr1-E7r`g$M)xavZ`BWIvcLRo2S0j>4NW@@p*&4& zQaYr^3}h#uFPb~fLdCO(ynt>F$vpeb>o9({0+2jEgPun)WYP|-;*y-cATLDpVz>KC z*`X93-F}tGaZ`As^V*0~6A)W|<9`gk2|^0dTvPlq0vh3{!^Ke6G8_ok9xTK~fC`a@ zHAYbIw^;ZLBW%r@g9xa%!UB+DwtDiYOHI)XY)oORAHVGs$h5xcEk9J6nmnjuxfud4 zY_D7e+Q^{S*ZmYsG_R)NsG_DddLEMeDi{_&_5hzxD)u)hA5}TAl>|3IQqS!r9-`R* zbw~7)JU1Qsumf_>tyB}F!ImA?>gv50GlxZ#5VC9wEF~r@`Fmf^M?$Bb+#M-1xYY67 z^KCUp-p%A)UXf2)*Bi~3G$ly-&~{6(@^3ZU`!pc4I8Bk2Wx{vja01xfSjpvuXmnnT z-`s(=wbIEasO(BXanAM0s2m(fAVOuIHwws4t>;9T&Oz$NQb?x$!ShuSS!Ae1t)1d% zRnP;_I1my8BBG%2=iFTv7QL(JD;{BM^0xaPpKkR8cr>&&Lq#2c5uOotGr%^V<_2?~ z`4APz*1w;#etI%FXG=_y;ofcyvaxLQpho1#)hx@a!}Zc#)oLso4ekOtJ2ua+UW%eV zq1i#eBFmE;9j-W?VT^X&R6GA1XO~PzWcVkX7x;-XaayfJPY)~gBv*HousJg_ibPaT4Ps<{3l~9%usnGO5cC$Y zPy(&%vtEkSu3Yg`P7*x7*i6T((9m-4B6v-sC`+NhBXN_n`I<0YWz_S4r(V*!_p1w~ zawjQ@t8sHM$`tx_caj-e=45$zlO z`urjh@!fB>Z*C>S>2S&l-XgS@=~TbbG=Ac}&~S9R{b<1eg&L8~4tL2a^USY$ev-4a zSz}9KrmJ@;+>5SHH9p4ZRniC~ud5_dv)4LtnLs zgZzfsUQ{xheCQrJ;cuyqIxX@USc&rJv0W?{gI#sC!SpzcA`K|~fygFAH&m0%hSZPh zltAb+`6h32siep!x8jnYVvM|w5qo9#i7_Vgu4`$PSVQenb=sfqlMuBcH8C3u=Zs(| zsSIx`Iisk~1Ie{Tht8u%XA4<*YiAV(B1~t7irEksk?sbjH zD0#kyyO*7bzT?LUqK4`&St0xM9SbhdKlZrcqE(T*lH6{sG*EL3NdrX0q{L&gOm{|QK z1QP?0j{a!b#~9_D;cO0wFHGB4&pT9XfAr!J5I%=NesS=_jjQGQvISWxQ`F!#Tr;U=Gdq?=g`pxh}+RFx72{EZmVW}$$U)Zttm=#l;hv%C-2gikT z&8RPMmO^nYG8Zu*R%;XBD9sn>B=Fax;}ywt8BTi!IQ#kd9A!lAz{0kkKX3-}k12e6)&S}+%`@|Fo} z)0HD5ax%*1e;l0~ov43tdcd{p9iw%T<;IgR#brxTr6K$2hxV z+t`DA9XL533l^2+wmL0K-fNCcwTiMeOgYomv1MYGFzVjlE--~?#*sqyxEt7=Lhju zf&LI-@Jm>_kjT|l-~GrZ&tz{AJ`HWfJE-d}a#>Oxr)S=041<)G4R- zJ^6lqzQnusps#bZ_JJu5WS^*I%aq+HOSFv7TK&DLlvP&T2n$kL5o7Pyjhep9)iP}3u4_C`?R-RaE|^Itq|)_?lj+jj7Ex%hL!5Hnk+ztl z%w_N>X{N;m%6TO#QO7e&RcU)vcjDpMb)TEuYDK%9h-U15G-z6vEt}*IS`?_>$>cJNCiv;QoeUOdpQ0+J!MSulTmfw_hk(-@j2!;0khMka*R+1{E>w zrso9AA;P>Ua;PW0m|E}6R3E-*mt*_HpoTilP9xuk1)fWtKFWMKTh57~n-&>{6CzrC z3nh*6DdRNJR97yH%`s3n3-8hIY*80d8^|6;Wcp-!(1cT?zi1<^L_;Ick(Crvhn$`q zAGtA%Xhj(tunMVpMB}3S`C?{dCt>Ft$H?1)<~1gp$SQvaoBT3BQ1{f7wEfhVT}iWnDt8;^(-yHWpSal zJNjCHW(fC+hEy1T5!ro#nW71!--!@@C=Q z0&Dt%vp4PEWjy;D6H8lEA_i@LGBkN)8gFZybQrkG%?Q!k2kJEIKPojB8sfN&3_$Oa z8|YnrN>$K&YJhvfYH7|pHzJRXY5m;r%b4AoOVEB)jFzE$k{Gs;m2;t6!jAXw-x$jQ zT6O8!`?!vZmD-_SL^B~>LIP7%toA`zP2Ye;@pw=i}^~8`T(F4(Bf0p>W z@}R}Dv+-pYvh&QpF?*u;&(ikYEk$xZFxls4?b%{^ zKj8fv$-s&*)6(7~s_$8g(Q-oeYyQgD{4)xr;0&RKhtUSJW9}YJQjT-Q%j9yA0+`Ju zDrZ5tR#TZY^`|TLX*(gepcj$~Sov)5d$}bJUXJ@n^@t2Z&E8KXgC{Lb2Qde9mYT7p zipazq-Q1wYQIb*y@x@GDB@us*rlqrYBD6xPy94yzA4_X>zW-SdU*j0T)?-V!dE@xy zF-G7c2mSoInpS-)tGCjB#&7NAk}1N~$_*`FA`HH2XP8Htp9lG;&_%>HKU9o9eXhHJ z!)Lh5XZ6>lgutXivAi;E9!)%2yYwneL@l*`)4GFS4{g*}idGh)_1Jg3dieKV<@?Q~ zOrs;3m-EUfFN&}Zd3#{v{N6%k#|LK~2LVa~f4rX)c)tfTlK&n_l*|FvSx1Cy+4g=v ztLlxx(Y2WV^*siPn~CPL^kIkViFePrx0V{ zaEF~`r$(;>gZReky5)!)D;4(KpCh;1;E|1JmCA~zp(h85ie&_6ifgip0p@LPK}+#7 zjX860@&)_3>8DS$Jwlg0pruaa%SU#dynXTg=d^U!j!jSF_0tlV14mjFZe93_M9jt0 z{YcVtjJJQznQt=qCM$ASwq19RY2J=nICJ=@#nqHqs+Iat>*w4^Q;b%ISJxo{W4Xdv z`95(^;DoXS`R3OsEB%{aIiDEph9=fNa>W0(l;;(Yihrct@9^pgJ8{LSsQ*Pwjl8vy z$n*ny{YKzgczRZw)6Nq)(Dnj&l|S$*T&B`~S`^v7!4)ChUHw_USiYqB$nL;B^`1tw zC-*k3nomr%CWxqFuEnm`e;WxTW?bO;-q_kyq%n)T6?JM8Y7^-u+x)(BSFX4pp;)y| zbzvZ%dJ=l*4|%w}fX_^&KPg$wWU-SpnZe#%8FPIL2$ccD}-U!}Ow3-lnDa4%AG z23aFy(kH{?(|Khs&+Fi%=uRYB%UBWx7#J(?%Fewj+^G(ZxcKOPAiRN3i6L4JOz8S3 z`hQ>dO^)Ej=0H^LDpnB&gXluRINFZu=ZN_{nXQYZ2f=}m&5IBNTLpT;RwS1c2)3GF zDB&v@Fuw0gH_0*4L8Ql05`Hh?%N6k43Ea-QAc^O94;WXKOEHb`o{Vq&lw(@V6Flxz z0F486s6~^nIDrYU2mos){`120&}2n6({Pa6zb65H$`vPojqU)PjeCIizgsZEfm+VL z`rp?U5$E{q>wA2@^s3`$Y)>@f*uu1V1&q=Wqk_8!#3u&Fa5f0H1xJWo5ko zz7854zuSuJ?ByR8r@00m8>c|bjM+l2lRNxYf`J4vbo6G^_N!i$hf1`G&uWRgQ%@*L>9D!-R8 zY@M5v3<9kAeFZlpU%r5TL$HK+ZSOl!SkI9`<4!dgxWkF*Axl#QIt3uPQwB=B(~vUX z5GC;FE&Ci2oF#D@3hu{a!if2F=m7anNit;-5|Tg(aQOhv*`S(Qr$@XKdTqjpdZayc zNc4f;H@TlZ7ZVd~PhS|r9@9nt>X=1K_}`cQe_#6l-%Fn~#b=c3dLPDD9nNV0Ug+yk zd{Fsz7pI*T_>{oJe}@%6S|}iAkp5rS-y Date: Tue, 27 Feb 2024 02:30:24 +0000 Subject: [PATCH 4/7] Updated readme.md --- README.md | 18 +++++++++++++++--- docs/img/flow.svg | 2 ++ 2 files changed, 17 insertions(+), 3 deletions(-) create mode 100644 docs/img/flow.svg diff --git a/README.md b/README.md index d95d4d2..160ceae 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# ATLAS +# ATLAS 🌍 Final year project by [Jesse Amarquaye](mailto:jesseamarquayelegendary@gmail.com "Send email") and Greatman Akomea, computer engineering students from [Ghana Communication Technology University](https://www.gctu.edu.gh "GCTU"). @@ -6,12 +6,24 @@ Final year project by [Jesse Amarquaye](mailto:jesseamarquayelegendary@gmail.com - [Introduction](#introduction) - [Why work on hallucination in LLMs?](#why-work-on-hallucination-in-llms) + - [Aims or Objectives](#aims-or-objectives) +- [Methodology](#methodology) ## Introduction Atlas is a hallucination detector for Large Language Models. -Its main focus is on **generative text** as it is the most widely used medium of interacting with LLMs. +Its main focus is on **generative text** as that is the most widely used medium for interacting with LLMs. ### Why work on hallucination in LLMs? -Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly *fluent* and *human-like text*. However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. This project aims to address this challenge by developing a software for **detecting** and **mitigating** hallucinations in LLMs. +Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly _fluent_ and _human-like text_. However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. This project aims to address this challenge by developing a software for **detecting** and **mitigating** hallucinations in LLMs so users can rely on LLM outputs with greater confidence, leading to wider adoption and societal benefits and also reduces the risk of misinformation and promotes responsible use of LLMs. + +### Aims or Objectives + +- [x] Explore techniques for mitigating hallucinations in LLMs. +- [ ] Develop a software for automatic detection of hallucinations in LLMs. +- [ ] Evaluate the effectiveness of the developed tool in different LLMs. + +## Methodology + +![Flow diagram](docs/img/flow.svg) diff --git a/docs/img/flow.svg b/docs/img/flow.svg new file mode 100644 index 0000000..fab05ff --- /dev/null +++ b/docs/img/flow.svg @@ -0,0 +1,2 @@ +
Start
Start
User queries LLM
User queries LLM
End
End
Atlas scans response and checks for signs of hallucination
Atlas scans resp...
Hallucination detection
Hallucination detect...
Propmt the user of possible hallucinations
Propmt the user of p...
Continue scanning response from LLM
Continue scanning re...
Crawl the web for the right response and present to the user
Crawl the web for th...

Flow Diagram

Flow Diagram +
Hallucination dectected
Hallucination dectected
No detection
No detection
Text is not SVG - cannot display
\ No newline at end of file From d84873737b615ba0f6b028a1c47f2eb1a9832119 Mon Sep 17 00:00:00 2001 From: Jesse Amarquaye <96346994+amarquaye@users.noreply.github.com> Date: Tue, 27 Feb 2024 03:00:52 +0000 Subject: [PATCH 5/7] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 160ceae..b5513ac 100644 --- a/README.md +++ b/README.md @@ -26,4 +26,4 @@ Large language models (LLMs) are revolutionizing human-computer interaction, gen ## Methodology -![Flow diagram](docs/img/flow.svg) +![Flow diagram](docs/img/flow.png) From d62aa00fbf9a3a668aaf783c00556e4e0bb50b64 Mon Sep 17 00:00:00 2001 From: Jesse Amarquaye <96346994+amarquaye@users.noreply.github.com> Date: Tue, 27 Feb 2024 03:06:31 +0000 Subject: [PATCH 6/7] Update README.md --- README.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index b5513ac..8295f55 100644 --- a/README.md +++ b/README.md @@ -16,7 +16,10 @@ Its main focus is on **generative text** as that is the most widely used medium ### Why work on hallucination in LLMs? -Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly _fluent_ and _human-like text_. However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. This project aims to address this challenge by developing a software for **detecting** and **mitigating** hallucinations in LLMs so users can rely on LLM outputs with greater confidence, leading to wider adoption and societal benefits and also reduces the risk of misinformation and promotes responsible use of LLMs. +Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly _fluent_ and _human-like text_. +However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. +As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. +This project aims to address this challenge by developing a software for **detecting** and **mitigating** hallucinations in LLMs so users can rely on LLM outputs with greater confidence, leading to wider adoption and societal benefits and also reduces the risk of misinformation and promotes responsible use of LLMs. ### Aims or Objectives From 1b633ed95d12e49b6189bf3b355d740fd21a6064 Mon Sep 17 00:00:00 2001 From: Jesse Amarquaye <96346994+amarquaye@users.noreply.github.com> Date: Tue, 27 Feb 2024 03:09:59 +0000 Subject: [PATCH 7/7] Update README.md --- README.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index 8295f55..fce5f4d 100644 --- a/README.md +++ b/README.md @@ -16,9 +16,9 @@ Its main focus is on **generative text** as that is the most widely used medium ### Why work on hallucination in LLMs? -Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly _fluent_ and _human-like text_. -However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. -As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. +Large language models (LLMs) are revolutionizing human-computer interaction, generating increasingly _fluent_ and _human-like text_. +However, a significant challenge in LLMs is their tendency to produce **hallucinations**, or factually incorrect, nonsensical, or misleading content. +As humans become increasingly reliant on LLMs for information and decision-making, ensuring their reliability and accuracy is crucial. This project aims to address this challenge by developing a software for **detecting** and **mitigating** hallucinations in LLMs so users can rely on LLM outputs with greater confidence, leading to wider adoption and societal benefits and also reduces the risk of misinformation and promotes responsible use of LLMs. ### Aims or Objectives @@ -29,4 +29,4 @@ This project aims to address this challenge by developing a software for **detec ## Methodology -![Flow diagram](docs/img/flow.png) +![Flow diagram](docs/img/flow.svg)