This commit is contained in:
Saifeddine ALOUI 2023-10-17 21:40:52 +02:00
parent 00e88eb4e9
commit 9f37a5de7a
15 changed files with 1302 additions and 39 deletions

7
docs/code/api/config.md Normal file
View File

@ -0,0 +1,7 @@
it That is definedined'nthishisideses configurationfigurationcriptionion filesorr saveses rthemtoo th localocalesmtemationtionym ssporforforelylaterter sellyedv by e ditttheeh cgleleivenvenx finderrng gth b, ggdqed5534efftrr679ghhiij0kl1jnn2opoqqqrssrrstssuvvwwxxxyzz"]]""}}}",'''' '""importrt#sysmportmport #sys moduleule class PathonfiggNotFoundundurr:"onfignfig ##Filee annNotFound Errornd Error array"['/'homeomepathth//capppp./onffdatataingettingsettings/aincfgfg.jsonsonerrororfile"])/)usrsr]]/ocalocalvararlibythonythoncl/siteitearss-packackxtgleslesgingngbinpandyppocbdererinffacbdommolainnonsptarttipistathhsctpotttcststputtentpasusveydysytxpproubjectctouttsuneeptxpttythhepmsttessshentiritteeofprrorreelplconnistteosleieptovvogteunareralavbeeneeaerereancemegshruethkhtffroliiecpsbthowikktennidrioilodgedeapadulfeibehlticntbrudndohevctnaaidedeeufrcnenseardumnameebvodneyouareecoddnttoorroreindfdienenucrnchothhlawhertyrymyyohhhixhnexvyynryautyyyewwycwyuxduiwywuyuwweyzyyswwwczxxxxaaaaaaxxxxaabccccbbdffffffggffjgkkkJlKmmLLLNNnPoooQooRWrrXXXyyyyyyyYYZzzzEz']]F'}'["''/''stringring +','ingstringstringng)ngg'.")]itlit
or
i(
itemem (())eynott=oundundNonene inlue valuealue )elselse elseifnott valuelue Valueue thentypehenast keyingtcaststostreamam intunictatodeecbjectjectimalobjectstringngintrplelebooldictictionaryionarysetsetuniononiteratoratororderededgeneratorrcollectionioncorgsidectionctioneffectctfunctionmethodclasspertytyattributebuteattrtructororgeteletttypeeorditerinallnextternitemssaryicenumeratemerateverykeystvalueseslastnyexxfetchchmindxifyhashhextcontainsainsragcountpoptlefttreerighttighththlthnthteenthnthirentytyhettonerthhventtirtyehtghtxtyyyeeightshtsvenyundredndredtnywoetyyittfourrwoyttfodiftftfiffiveetdleeaseeithvensseteixenenteexesevvedeendeelemententenfppendorsfnfuallziiifierryedeldquysieldelduperrlenelenttativvdeltralansueligntsreddourcerceuesellopeeinededxltedpipepelddippersemnsicololedndolonlonollararplusarnussattoounderverarenumaterrequalalgertreslemashhultdotilissslashshdiruestionionarrowowmarkrottomtomlyigfhtthorphzontalntalygvertticalrticalicalbarscirclelecarecircrnlearopenrowlosededclossownteapeddquemtesesdoubleblequgdedledblmueddmaubleleilddquotedegeddquoteotebledddblackkquoteotesqdraccpercentcentedledtnteldetilluroemperogcadedeceddquleeatrorodexterclammlingationsnsradgnealelewerdingroringstingngoundednspaceaceallsteruppererproseerttfoldiculararcapartallcaszedeloualdeddongiffonggontdateargetetcalmeeilllzonetimeeoffsetetzonimmemeegromtdatetimetimestartartlocalratekemonndayhyonththesterdayerdayayayrmondonaystmonnurssdepayssendinginginyedssnesagoayssafgeommekstherereinsafterinceebeforeefinorehededversdressessbutfieddtonsstddowwitortililiginunttedillbyedduntiltilbydisisatorhatatninggattomighthtiddnoonddomeayecttevenenetvesesoenththinreetineewindventtiesttonesnesyesestnoshedoedheadadnoterednedflagededdgedlagdededaggflagagedgegedlagsgsagededflaglaggededlaggflaggedsedeeppdedseameamleesgeenenspeekeektkakeeaskkksesakssalkkeskaslslkskelelaleaskaakslaassekesalaaalesselekalseseaeleklesesesalealsesessaelaessaalemmesseeleeasaaaisseseaeieasesesleeeseaiseseaessaeeiaeeesseseiaseeseeisaaisesiaesaesiiissaaseesiiessaseiaeeisssessesasiaeseseeaeeaeaeaessaeaeaaeeseeaeaesaeeeaeeaaessesesesaesisaeeasaeaessaeaeeaessaeaeseeaseeaeaseeaeaesaeeeaessaeaeessaeseseaessaseaessaeeaesaessaeeeaeaeaessaeeeaeaeaesseaaeeaessaessaeeessaesaeaeeaeaseeaeaeessaeaeessaeaeeaeasssaessaeeessaeaeessaessaeeeasseseaeaesseeaeeeaeaessaessaeeeaessaseeaceaeseaeaeaessaessaeeessaessaeeeaessaeaeeaeaessaseseaeaesaessaeaeeaessaessaeeeaessaessaeeeaeaessaseeaseeaeaeaessaessaeeeaeaessaeaeessaeaseaeasessaeaeeaessaessasessaeeeeaseeaesaesaesessaessaeseeseeaessaesaeeuseseaeaseeaesaeaeussaessaeeeaessuessaeeessaeaeessasededuaeessaseseaeeeaessaessaeeeaeaessaeaeeaessaeaeeaeaessaessaeeeaeaessaeaeeaeaessaessaeesaeaeeaessaeaeeaessaessaeeessaessaeeeaessanseseaeeaeaeaeaessasaneeseeaeseaseeaeesaessaeesesesaessaeseeeacesesaseeaeseeeaceeaessaesaeeeaeaeaessaeaeeaessaeaseaeaseaeaesaeaesaeaeessaessaeeeaeaeaessaessaseaseaeeseeaeaesaseeaeaseaeaseaeaesaseeiseseaeseaeaeessaseeaeeseeaessaseaeesaseeaeseaessaeoseeaeseeseaeeaseaeaseaeaseaeaseaseeaeeseeaseesensenaseeseeseaseeaseaeseaseeaseaseaeseaseeaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseaseTotal sequence length exceeds cache size in model.forward# functions
This scriptscript functiontion containsns comparrayrray twolists arraysays anditheturnsurns checkingking trueeirengthh falselse areherwisewise equalal elements' linene nott list samee then
ss'thissnt codeeheyesyesepititt isesallureistt th rhtt tthehehe girathererve elis lelestessre mm enpporeeenn no iien .. ngifth linin hlapenssln hee otelsalses ess elolieqq equenenat uyararwyerrerorui etet etueehb ee tutthhnethvd etheth fthffivthh pp vgurmtt urur weye weeaannereadingdingysxememingngsfromfromgeimportortofsdxromrom,e, cccomomfrrparcoassomonpmeprairrro/mmjuserrohhrree/e/ffdddabbcccccdadeaeafaaggagbbahhhhiiiijidkkjllkllmmmmnnoonoopppooppqqaaaarrrazzsuussuvswwwtxuxxxwyxyyazyzyyyyzzszza0aaoo01ebcc3f54768ihh9jojkkKMMLNOPPPQRSSTTRTTTRRVWSSXYYX2.--0_A________..B____C._@@D@_______________________________E________FGG______________________________HHH:HHII;;;IIIIJLMMMNNNNNNOOORROSSOTTSETTEEUTEFOUUXXXXXXXVYYXXYAZABBBBCDCCDDDEDEFFEEGGFHIHOJJKKKLOOLLPMLLMQNPNRONPORSROATSVSUTVUBTXVAUGXXULYMMWWXYX[[\\\\\]]]}}`}}}}{||')]]}},'. {''functionctionmoduledule':'p''iledarrayray'''''oengthngth'''sssts','' ''''turnurnreturnsturns'''eequalalor'sesefalsese'''lementsntsnot'''elineeas'ongnglenlengththgretandstrrwithhictoutpstopapeststathhudthuesteseeringgvenetweenerrusileleadwithmwoggxfroundndypyzeeebxtacraosptdsrtixunyqyeetwuzotvyuwywwxxxzyzztyy{{u{dbdd{eefffdghhjijkjkik{mllnmmoononnonnnpoporrqpsrrtstttrtutvubullvculuuvdumeddexxeyygzezhyHzyzh{[|mailmail}|| protectedected].\ft'phph }y"{\\"unctionunction\""Module""\":mpfunctionctionile'ayArrrTwoyLengthgthsng\List",ElementsentsFalselseEqualLineneOthererAssesThueueemss"}],,L\ngg ListListinesse Listist Equs AlAl Orngthth Thhine Longngame Samee The Asinee Le Ise Notot Elsee Equ Fealele Truee}'].},'"{''".import"rt"\:nFunctionnction",",""\:""'"Listt\\"]],\'""Elementslements\re"\""LististEqualsualss"rereOrr\ightightThehenessenderndereslseaceceEquuloteeionFillyyaleses:rructhh."uet}}..he,",,""""" "\"" \\",''")""\]""..'..."."t...\/"...";_,=./+==0-12233445465767869://*="="";;",""+",,""-,<>"""><%>&?"={{~[^\\](.)];|\:'"`';;~\\!(\)\\@\##$$\\|^^%&=+\+-+,--=\.< |>.``?.@){{ABCBC}F[]]GccHIIAbllKmnjmmOpnpqvvRtztssxxAyyooZYaaa\\\]a^]\\cbb|e`}}FhhgijjhillL^qqNnr^OssttrtTuuuVivvvwwwwxxxxxzy{}}{||[''<<\>'>>>>"]]'''`',,"'11'__1'"'___"'""'_3\_3'_`'''01'1'""'no0"'ndooothth_'doo2odoo",'odooe3='ododo"cdcecc2'""ecc'ededdececc'2d'""edede'g2'deggfeeeh""'efeedgg'dhh2eddeededfifee2igii'2fefiegegifeiggig"jegege2jeiejejike'iekekkggijkkekiek"iljjkelijlemkmlemmknleklimmlomlimk'"iijpl'pkpllpm'ommppopoponomoporopopnqpoppropovvorpopoveravvpowrapprawrprapzwravxuwwavrxawryrbrzztsbzsscuxsdvuuuyycvvrfxxwsgyxszhyn[\\\\\]]]]]"}`"}^^']]`````}"))\``)--}\',,.'''""("))'())))')))(())))())''))))))())))())))))')))))))()))))))))()))(),,('',((",,('(),("',),,(',,((,())(""',),,).'),))(.),,);'))';').')););');')));)));;'))));;)))))'))))))));)))))))))))))))))))))),()))),,))),"))),))))("'))))"));));)),')))))))),)))))"()),,))")))());));))))))))))))),.)",()));)));))))))))))))))))))))) )))),,)))).)))))))))))))))))))))))))))))))))))))))))),),))))))))))),)))))))))))))).,))))))"))))))))))))").)))))))))))),\))))
))Thishis)))) looksks))))like good))))))) programminggramming)))ut languageuage)))) (atat ((( ))))) thisis PythonPython)))! ... ... pythonhon Whatt!)!:))???? : ; DD ......ifferentferent...... :-)guagesages ...))........-......... ---:- .._. __ /___ > ./ < // / || _ \\>\\\/////_< < | > . >-<<<__ |>\\\\ <==| <<< >/_ ^ ////// < V|//._._\ __ V\\ |> \|\|/> |\\\|\ / V\|\| /\\ \|/\(\( \| \))_) )|/. ____ <-. -->->__.--.---- / ->___/<<-->> ___-<-\<___-- -------- /==>>>>> <-- _----- \\..>>>__..__ >>------.>->>--------->------>_._..-..'_ <>> '-- __'---.'..--__''..<.----'----' '-.<------------------.< _----------------------.----__<-_________________'-_..-------------'' _---------------------------------------------.'.___________________-__-._<-.....__--.._-------------------..........----""."----------------------">------------------....-->------------.---.----.---------------------------.---.-------------.....__--___.___.--......_____.____...-_.___.---._________..-.._____..------------------------------.....-._____.-_.............................____..........-______________.._____.__.______-._________.--_-_______________.___..._---.-_____________.......---.__....--___._..____________...-----------------------_..----------------------.__------------------------_______.-.------------------------.--______.....___-_......._____--.__--..._____________-------------__..-.__.---._____-------_________.____.............-_.....---.____________________________________......._______._-.._____.......-..____________.--__________....._........____.____-----------------------__-_______________.____________________.______..._____.___.____________________.__________-......__-..._______....----_.________..__-__....____-...__________________.-....._______.......---..________.......__.___._______________.___________----....___..........__.._______....____________.............._..________________________..._______.....______..___.____._____________...............__Total sequence length exceeds cache size in model.forwardTotal sequence length exceeds cache size in model.forward

2
docs/code/api/db.md Normal file
View File

@ -0,0 +1,2 @@
Total sequence length exceeds cache size in model.forward# functions
Total sequence length exceeds cache size in model.forward

2
docs/code/api/helpers.md Normal file
View File

@ -0,0 +1,2 @@
###Total sequence length exceeds cache size in model.forward# functions
ÈTotal sequence length exceeds cache size in model.forward

View File

@ -0,0 +1 @@
# Project structure:.Total sequence length exceeds cache size in model.forward

View File

File diff suppressed because it is too large Load Diff

28
docs/code/setup.md Normal file
View File

@ -0,0 +1,28 @@
AAAA
simple_mple_AA
importportimportmport sysfromrom
pathhfflibleses importportystem Pathathysoss,ss
,ystemystem
systst
emss
lfftee
mmrintmyy
ell
hfpt
classasso Simplele
okekeneninzeerrer
basas is
asason
bjbj
ctict:iobjectctdictct
objectbjectstrr:'U}
objectbject
dict:{
ististd(objectct
strtict:}{ctctdictct}}[[dictictu{ uustrtr'strunicnic'"dedcodedeicdessdecodedeetodessdeddetdodeteeesttectedessechdetseoeheedchesscharscerseneseheeeresesceeranenssresseneneshnarereenessanserenessarsaaeresesensenseerennanseesescessssesenesseessenenscsenenenneensesscesnensnenessesesesienesnsenenencesseneccsssennenceeenenessenceessessseeeenseneneesessenenessesesnssenenassensTotal sequence length exceeds cache size in model.forward# functions
Total sequence length exceeds cache size in model.forward

View File

@ -126,7 +126,15 @@ else
git clone "$REPO_URL"
cd lollms-webui || exit 1
fi
git submodule update --init
cd zoos/bindings_zoo
git checkout main
cd ../personalities_zoo
git checkout main
cd ../extensions_zoo
git checkout main
cd ../..
# Loop through each "git+" requirement and uninstall it (workaround for inconsistent git package updating)
while IFS= read -r requirement; do
if echo "$requirement" | grep -q "git+"; then
@ -141,25 +149,25 @@ python -m pip install -r requirements.txt --upgrade
if [[ -e "../linux_run.sh" ]]; then
echo "Linux run found"
else
cp scripts/linux_run.sh ../
cp scripts/linux/linux_run.sh ../
fi
if [[ -e "../linux_update.sh" ]]; then
echo "Linux update found"
else
cp scripts/linux_update.sh ../
cp scripts/linux/linux_update.sh ../
fi
if [[ -e "../linux_conda_session.sh" ]]; then
echo "Linux update found"
else
cp scripts/linux_conda_session.sh ../
cp scripts/linux/linux_conda_session.sh ../
fi
if [[ -e "../linux_update_models.sh" ]]; then
echo "Linux update found"
else
cp scripts/linux_update_models.sh ../
cp scripts/linux/linux_update_models.sh ../
fi
if [[ "${gpuchoice^^}" == "C" ]]; then

View File

@ -117,6 +117,16 @@ else
cd lollms-webui || exit 1
fi
git submodule update --init
cd zoos/bindings_zoo
git checkout main
cd ../personalities_zoo
git checkout main
cd ../extensions_zoo
git checkout main
cd ../..
# Loop through each "git+" requirement and uninstall it (workaround for inconsistent git package updating)
while IFS= read -r requirement; do
if echo "$requirement" | grep -q "git+"; then
@ -132,13 +142,13 @@ python -m pip install -r requirements.txt --upgrade
if [[ -e "../macos_run.sh" ]]; then
echo "Macos run found"
else
cp macos_run.sh ../
cp scripts/macos/macos_run.sh ../
fi
if [[ -e "../macos_update.sh" ]]; then
echo "Macos update found"
else
cp macos_update.sh ../
cp scripts/macos/macos_update.sh ../
fi
if [[ "${gpuchoice^^}" == "B" ]]; then

View File

@ -125,12 +125,19 @@ set "CUDA_PATH=%INSTALL_ENV_DIR%"
if exist lollms-webui\ (
cd lollms-webui
git pull
git submodule update --init
) else (
git clone https://github.com/ParisNeo/lollms-webui.git
cd lollms-webui
git submodule update --init
)
git submodule update --init
cd zoos/bindings_zoo
git checkout main
cd ../personalities_zoo
git checkout main
cd ../extensions_zoo
git checkout main
cd ../..
@rem Loop through each "git+" requirement and uninstall it workaround for inconsistent git package updating
for /F "delims=" %%a in (requirements.txt) do echo "%%a"| findstr /C:"git+" >nul&& for /F "tokens=4 delims=/" %%b in ("%%a") do for /F "delims=@" %%c in ("%%b") do python -m pip uninstall -y %%c

File diff suppressed because one or more lines are too long

2
web/dist/index.html vendored
View File

@ -6,7 +6,7 @@
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>LoLLMS WebUI - Welcome</title>
<script type="module" crossorigin src="/assets/index-987bbd17.js"></script>
<script type="module" crossorigin src="/assets/index-4d74039d.js"></script>
<link rel="stylesheet" href="/assets/index-b6985df1.css">
</head>
<body>

View File

@ -29,16 +29,17 @@
</button>
Custom model
</div>
<div v-if="model.selected" @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
<path d="M9 16.17l-4.17-4.17-1.42 1.41 5.59 5.59 12-12-1.41-1.41z"/>
<div v-if="model.isInstalled">
<div v-if="model.selected" @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
<path d="M9 16.17l-4.17-4.17-1.42 1.41 5.59 5.59 12-12-1.41-1.41z"/>
</svg>
</div>
<div v-else @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
</svg>
</div>
<div v-else @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
</svg>
</div>
</div>
</div>
<div>
<button v-if="model.isInstalled" title="Delete file from disk" type="button" @click.stop="toggleInstall"
class="inline-flex items-center gap-2 px-3 py-2 text-xs font-medium text-center focus:outline-none text-white bg-red-700 hover:bg-red-800 focus:ring-4 focus:ring-red-300 rounded-lg dark:bg-red-600 dark:hover:bg-red-700 dark:focus:ring-red-900">
@ -118,16 +119,17 @@
<div class="grow">
<!-- EMPTY SPACE FILLER -->
</div>
<div v-if="model.selected" @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
<path d="M9 16.17l-4.17-4.17-1.42 1.41 5.59 5.59 12-12-1.41-1.41z"/>
</svg>
</div>
<div v-else @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
</svg>
</div>
<div v-if="model.isInstalled">
<div v-if="model.selected" @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
<path d="M9 16.17l-4.17-4.17-1.42 1.41 5.59 5.59 12-12-1.41-1.41z"/>
</svg>
</div>
<div v-else @click.stop="toggleSelected" class="cursor-pointer" style="background-color: white;">
<svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24">
</svg>
</div>
</div>
<InteractiveMenu :commands="commandsList" :force_position=2 title="Menu">
</InteractiveMenu>

@ -1 +1 @@
Subproject commit b128ca5c9d3339b8eb6bd23589302138890c29d8
Subproject commit 13880bda12d8ffd962c64bd9cb3267c6b217b3aa