diff --git a/document.aux b/document.aux index 1583c76..47e77b5 100644 --- a/document.aux +++ b/document.aux @@ -295,8 +295,9 @@ \@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {section}{\numberline {14}Conclusion and Future Improvements}{89}{section.14}} \@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {subsection}{\numberline {14.1}Conclusion}{89}{subsection.14.1}} \@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {subsection}{\numberline {14.2}Future Improvements}{90}{subsection.14.2}} -\@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {section}{\numberline {15}Appendices}{97}{section.15}} -\@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {subsection}{\numberline {15.1}Appendix A - Project Initiation Document}{97}{subsection.15.1}} +\abx@aux@segm{0}{0}{langdectNLTK} +\@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {section}{\numberline {15}Appendices}{98}{section.15}} +\@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {subsection}{\numberline {15.1}Appendix A - Project Initiation Document}{98}{subsection.15.1}} \abx@aux@refcontextdefaultsdone \abx@aux@defaultrefcontext{0}{SaTdpsmm}{none/global//global/global} \abx@aux@defaultrefcontext{0}{nlAeiBTCPSO}{none/global//global/global} @@ -349,4 +350,4 @@ \abx@aux@defaultrefcontext{0}{SpamOrHamGit}{none/global//global/global} \abx@aux@defaultrefcontext{0}{MBE}{none/global//global/global} \abx@aux@defaultrefcontext{0}{TwitterTerms}{none/global//global/global} -\@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {subsection}{\numberline {15.2}Appendix B - Log book}{110}{subsection.15.2}} +\@writefile{toc}{\defcounter {refsection}{0}\relax }\@writefile{toc}{\contentsline {subsection}{\numberline {15.2}Appendix B - Log book}{111}{subsection.15.2}} diff --git a/document.bcf b/document.bcf index 88d7d4e..1c7d767 100644 --- a/document.bcf +++ b/document.bcf @@ -2018,6 +2018,7 @@ MBE VADERPaper TwitterTerms + langdectNLTK * diff --git a/document.blg b/document.blg index 31d1aff..9e0171f 100644 --- a/document.blg +++ b/document.blg @@ -1,29 +1,29 @@ [0] Config.pm:302> INFO - This is Biber 2.9 [0] Config.pm:305> INFO - Logfile is 'document.blg' -[21] biber:313> INFO - === Sun Apr 28, 2019, 17:50:48 -[37] Biber.pm:371> INFO - Reading 'document.bcf' -[89] Biber.pm:854> INFO - Using all citekeys in bib section 0 -[99] Biber.pm:3981> INFO - Processing section 0 -[107] Biber.pm:4154> INFO - Looking for bibtex format file 'report.bib' for section 0 -[109] bibtex.pm:1468> INFO - LaTeX decoding ... -[154] bibtex.pm:1294> INFO - Found BibTeX data source 'report.bib' -[170] Utils.pm:169> WARN - year field 'Dec 15, 2016' in entry 'dropoutM' is not an integer - this will probably not sort properly. -[183] Utils.pm:169> WARN - year field 'Apr 7, 2018' in entry 'RMSEMAE' is not an integer - this will probably not sort properly. -[196] Utils.pm:169> WARN - year field 'Feb 26, 2018' in entry 'StemvsLem' is not an integer - this will probably not sort properly. -[210] Utils.pm:169> WARN - year field 'Effective: May 25, 2018' in entry 'TwitterTerms' is not an integer - this will probably not sort properly. -[212] Utils.pm:169> WARN - year field 'Aug 2, 2017' in entry 'SpamCScratch' is not an integer - this will probably not sort properly. -[222] Utils.pm:169> WARN - Name "Mairal, J., Ponce, J., Sapiro, G., Zisserman, A." has too many commas: skipping name -[240] Utils.pm:169> WARN - year field 'Mar 13, 2016' in entry 'LSTMdia' is not an integer - this will probably not sort properly. -[275] Utils.pm:169> WARN - year field 'Sep 8, 2017' in entry 'MAPE' is not an integer - this will probably not sort properly. -[277] Utils.pm:169> WARN - year field 'Aug 2, 2017' in entry 'SpamOrHamGit' is not an integer - this will probably not sort properly. -[282] Utils.pm:169> WARN - year field 'Oct 16, 2018' in entry 'MSE' is not an integer - this will probably not sort properly. -[297] Utils.pm:169> WARN - year field 'Mar 23, 2016' in entry 'MBE' is not an integer - this will probably not sort properly. -[320] Utils.pm:169> WARN - BibTeX subsystem: warning: comma(s) at end of name (removing) -[320] Utils.pm:169> WARN - BibTeX subsystem: author, warning: comma(s) at end of name (removing) -[348] UCollate.pm:68> INFO - Overriding locale 'en-US' defaults 'normalization = NFD' with 'normalization = prenormalized' -[348] UCollate.pm:68> INFO - Overriding locale 'en-US' defaults 'variable = shifted' with 'variable = non-ignorable' -[348] Biber.pm:3809> INFO - Sorting list 'none/global//global/global' of type 'entry' with template 'none' and locale 'en-US' -[348] Biber.pm:3815> INFO - No sort tailoring available for locale 'en-US' -[375] bbl.pm:617> INFO - Writing 'document.bbl' with encoding 'ascii' -[393] bbl.pm:720> INFO - Output to document.bbl -[394] Biber.pm:110> INFO - WARNINGS: 13 +[19] biber:313> INFO - === Sun Apr 28, 2019, 20:09:58 +[33] Biber.pm:371> INFO - Reading 'document.bcf' +[80] Biber.pm:854> INFO - Using all citekeys in bib section 0 +[89] Biber.pm:3981> INFO - Processing section 0 +[97] Biber.pm:4154> INFO - Looking for bibtex format file 'report.bib' for section 0 +[98] bibtex.pm:1468> INFO - LaTeX decoding ... +[140] bibtex.pm:1294> INFO - Found BibTeX data source 'report.bib' +[158] Utils.pm:169> WARN - year field 'Mar 13, 2016' in entry 'LSTMdia' is not an integer - this will probably not sort properly. +[161] Utils.pm:169> WARN - year field 'Sep 8, 2017' in entry 'MAPE' is not an integer - this will probably not sort properly. +[166] Utils.pm:169> WARN - year field 'Aug 2, 2017' in entry 'SpamCScratch' is not an integer - this will probably not sort properly. +[178] Utils.pm:169> WARN - year field 'Effective: May 25, 2018' in entry 'TwitterTerms' is not an integer - this will probably not sort properly. +[187] Utils.pm:169> WARN - year field 'Feb 26, 2018' in entry 'StemvsLem' is not an integer - this will probably not sort properly. +[192] Utils.pm:169> WARN - year field 'Dec 15, 2016' in entry 'dropoutM' is not an integer - this will probably not sort properly. +[226] Utils.pm:169> WARN - Name "Mairal, J., Ponce, J., Sapiro, G., Zisserman, A." has too many commas: skipping name +[232] Utils.pm:169> WARN - year field 'Mar 23, 2016' in entry 'MBE' is not an integer - this will probably not sort properly. +[237] Utils.pm:169> WARN - year field 'Aug 2, 2017' in entry 'SpamOrHamGit' is not an integer - this will probably not sort properly. +[244] Utils.pm:169> WARN - year field 'Oct 16, 2018' in entry 'MSE' is not an integer - this will probably not sort properly. +[278] Utils.pm:169> WARN - year field 'Apr 7, 2018' in entry 'RMSEMAE' is not an integer - this will probably not sort properly. +[288] Utils.pm:169> WARN - BibTeX subsystem: warning: comma(s) at end of name (removing) +[288] Utils.pm:169> WARN - BibTeX subsystem: author, warning: comma(s) at end of name (removing) +[313] UCollate.pm:68> INFO - Overriding locale 'en-US' defaults 'normalization = NFD' with 'normalization = prenormalized' +[313] UCollate.pm:68> INFO - Overriding locale 'en-US' defaults 'variable = shifted' with 'variable = non-ignorable' +[313] Biber.pm:3809> INFO - Sorting list 'none/global//global/global' of type 'entry' with template 'none' and locale 'en-US' +[313] Biber.pm:3815> INFO - No sort tailoring available for locale 'en-US' +[337] bbl.pm:617> INFO - Writing 'document.bbl' with encoding 'ascii' +[354] bbl.pm:720> INFO - Output to document.bbl +[354] Biber.pm:110> INFO - WARNINGS: 13 diff --git a/document.log b/document.log index 75824a3..abd7905 100644 --- a/document.log +++ b/document.log @@ -1,4 +1,4 @@ -This is pdfTeX, Version 3.14159265-2.6-1.40.18 (TeX Live 2017/Debian) (preloaded format=pdflatex 2018.10.16) 28 APR 2019 19:03 +This is pdfTeX, Version 3.14159265-2.6-1.40.18 (TeX Live 2017/Debian) (preloaded format=pdflatex 2018.10.16) 28 APR 2019 20:09 entering extended mode restricted \write18 enabled. %&-line parsing enabled. @@ -849,22 +849,22 @@ File: english.lbx 2017/12/19 v3.10 biblatex localization (PK/JW/AB) (./document.aux) \openout1 = `document.aux'. -LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for PD1/pdf/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. -LaTeX Font Info: Checking defaults for PU/pdf/m/n on input line 108. -LaTeX Font Info: ... okay on input line 108. +LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for PD1/pdf/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. +LaTeX Font Info: Checking defaults for PU/pdf/m/n on input line 107. +LaTeX Font Info: ... okay on input line 107. (/usr/share/texlive/texmf-dist/tex/context/base/mkii/supp-pdf.mkii [Loading MPS to PDF converter (version 2006.09.02).] @@ -960,9 +960,9 @@ Package biblatex Warning: Biber reported the following issues A." has too many commas: skipping name. ) -Package biblatex Info: Reference section=0 on input line 108. -Package biblatex Info: Reference segment=0 on input line 108. -Package hyperref Info: Link coloring OFF on input line 108. +Package biblatex Info: Reference section=0 on input line 107. +Package biblatex Info: Reference segment=0 on input line 107. +Package hyperref Info: Link coloring OFF on input line 107. (/usr/share/texlive/texmf-dist/tex/latex/hyperref/nameref.sty Package: nameref 2016/05/21 v2.44 Cross-referencing by name of section @@ -971,9 +971,9 @@ Package: gettitlestring 2016/05/16 v1.5 Cleanup title references (HO) ) \c@section@level=\count357 ) -LaTeX Info: Redefining \ref on input line 108. -LaTeX Info: Redefining \pageref on input line 108. -LaTeX Info: Redefining \nameref on input line 108. +LaTeX Info: Redefining \ref on input line 107. +LaTeX Info: Redefining \pageref on input line 107. +LaTeX Info: Redefining \nameref on input line 107. (./document.out) (./document.out) \@outlinefile=\write5 @@ -982,14 +982,14 @@ LaTeX Info: Redefining \nameref on input line 108. File: images/reading_logo.png Graphic file (type png) -Package pdftex.def Info: images/reading_logo.png used on input line 111. +Package pdftex.def Info: images/reading_logo.png used on input line 110. (pdftex.def) Requested size: 170.71916pt x 56.9057pt. -LaTeX Font Info: Try loading font information for U+msa on input line 111. +LaTeX Font Info: Try loading font information for U+msa on input line 110. (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsa.fd File: umsa.fd 2013/01/14 v3.01 AMS symbols A ) -LaTeX Font Info: Try loading font information for U+msb on input line 111. +LaTeX Font Info: Try loading font information for U+msb on input line 110. (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsb.fd File: umsb.fd 2013/01/14 v3.01 AMS symbols B @@ -1002,36 +1002,36 @@ File: umsb.fd 2013/01/14 v3.01 AMS symbols B \openout6 = `document.toc'. [9] [10] [11] -LaTeX Font Info: Try loading font information for OMS+cmr on input line 225. +LaTeX Font Info: Try loading font information for OMS+cmr on input line 224. (/usr/share/texlive/texmf-dist/tex/latex/base/omscmr.fd File: omscmr.fd 2014/09/29 v2.5h Standard LaTeX font definitions ) LaTeX Font Info: Font shape `OMS/cmr/m/n' in size <12> not available -(Font) Font shape `OMS/cmsy/m/n' tried instead on input line 225. +(Font) Font shape `OMS/cmsy/m/n' tried instead on input line 224. [12] [13] [14] -Underfull \hbox (badness 10000) in paragraph at lines 241--243 +Underfull \hbox (badness 10000) in paragraph at lines 240--242 [] -Underfull \hbox (badness 10000) in paragraph at lines 250--252 +Underfull \hbox (badness 10000) in paragraph at lines 249--251 [] -Underfull \hbox (badness 10000) in paragraph at lines 260--262 +Underfull \hbox (badness 10000) in paragraph at lines 259--261 [] [15] -Underfull \hbox (badness 10000) in paragraph at lines 270--272 +Underfull \hbox (badness 10000) in paragraph at lines 269--271 [] -Underfull \hbox (badness 10000) in paragraph at lines 279--281 +Underfull \hbox (badness 10000) in paragraph at lines 278--280 [] @@ -1039,64 +1039,64 @@ Underfull \hbox (badness 10000) in paragraph at lines 279--281 File: images/perceptron.png Graphic file (type png) -Package pdftex.def Info: images/perceptron.png used on input line 387. +Package pdftex.def Info: images/perceptron.png used on input line 386. (pdftex.def) Requested size: 284.52713pt x 170.72142pt. [24 <./images/perceptron.png>] File: images/rnn_ffn.png Graphic file (type png) -Package pdftex.def Info: images/rnn_ffn.png used on input line 407. +Package pdftex.def Info: images/rnn_ffn.png used on input line 406. (pdftex.def) Requested size: 426.80307pt x 170.72112pt. [25 <./images/rnn_ffn.png>] File: images/lstm.png Graphic file (type png) -Package pdftex.def Info: images/lstm.png used on input line 425. +Package pdftex.def Info: images/lstm.png used on input line 424. (pdftex.def) Requested size: 256.07123pt x 199.1616pt. [26 <./images/lstm.png>] [27] [28] [29] [30] -Overfull \hbox (4.49005pt too wide) detected at line 532 +Overfull \hbox (4.49005pt too wide) detected at line 531 \OML/cmm/m/it/12 Probability of Outcome \OMS/cmsy/m/n/12 \ \OML/cmm/m/it/12 E vidence \OT1/cmr/m/n/12 = [] [] -Underfull \hbox (badness 10000) in paragraph at lines 542--545 +Underfull \hbox (badness 10000) in paragraph at lines 541--544 [] [31] -Underfull \hbox (badness 10000) in paragraph at lines 559--561 +Underfull \hbox (badness 10000) in paragraph at lines 558--560 [] -Overfull \hbox (9.8438pt too wide) detected at line 564 +Overfull \hbox (9.8438pt too wide) detected at line 563 \OML/cmm/m/it/12 P\OT1/cmr/m/n/12 (\OML/cmm/m/it/12 w\OMS/cmsy/m/n/12 j\OML/cmm /m/it/12 spam\OT1/cmr/m/n/12 ) = [] [] [32] [33] -Underfull \hbox (badness 10000) in paragraph at lines 581--583 +Underfull \hbox (badness 10000) in paragraph at lines 580--582 [] -Underfull \hbox (badness 10000) in paragraph at lines 585--587 +Underfull \hbox (badness 10000) in paragraph at lines 584--586 [] -Underfull \hbox (badness 10000) in paragraph at lines 588--592 +Underfull \hbox (badness 10000) in paragraph at lines 587--591 [] -Underfull \hbox (badness 10000) in paragraph at lines 593--595 +Underfull \hbox (badness 10000) in paragraph at lines 592--594 [] -Underfull \hbox (badness 10000) in paragraph at lines 596--600 +Underfull \hbox (badness 10000) in paragraph at lines 595--599 [] @@ -1104,25 +1104,25 @@ Underfull \hbox (badness 10000) in paragraph at lines 596--600 File: images/Generic_Flow.png Graphic file (type png) -Package pdftex.def Info: images/Generic_Flow.png used on input line 693. +Package pdftex.def Info: images/Generic_Flow.png used on input line 692. (pdftex.def) Requested size: 512.13474pt x 227.62009pt. -Overfull \hbox (71.28728pt too wide) in paragraph at lines 693--694 +Overfull \hbox (71.28728pt too wide) in paragraph at lines 692--693 [][] [] [41 <./images/Generic_Flow.png (PNG copy)>] -Underfull \hbox (badness 10000) in paragraph at lines 704--706 +Underfull \hbox (badness 10000) in paragraph at lines 703--705 [] File: images/Dataflow.png Graphic file (type png) -Package pdftex.def Info: images/Dataflow.png used on input line 709. +Package pdftex.def Info: images/Dataflow.png used on input line 708. (pdftex.def) Requested size: 512.09683pt x 227.62125pt. -Overfull \hbox (71.24937pt too wide) in paragraph at lines 709--711 +Overfull \hbox (71.24937pt too wide) in paragraph at lines 708--710 [] [] @@ -1130,16 +1130,16 @@ Overfull \hbox (71.24937pt too wide) in paragraph at lines 709--711 File: images/Data_Collector.png Graphic file (type png) -Package pdftex.def Info: images/Data_Collector.png used on input line 717. +Package pdftex.def Info: images/Data_Collector.png used on input line 716. (pdftex.def) Requested size: 426.78574pt x 227.61746pt. [43 <./images/Data_Collector.png (PNG copy)>] File: images/Analysis_Engine.png Graphic file (type png) -Package pdftex.def Info: images/Analysis_Engine.png used on input line 732. +Package pdftex.def Info: images/Analysis_Engine.png used on input line 731. (pdftex.def) Requested size: 483.67276pt x 227.62561pt. -Overfull \hbox (42.8253pt too wide) in paragraph at lines 732--734 +Overfull \hbox (42.8253pt too wide) in paragraph at lines 731--733 [] [] @@ -1147,10 +1147,10 @@ Overfull \hbox (42.8253pt too wide) in paragraph at lines 732--734 File: images/Neural_Network.png Graphic file (type png) -Package pdftex.def Info: images/Neural_Network.png used on input line 750. +Package pdftex.def Info: images/Neural_Network.png used on input line 749. (pdftex.def) Requested size: 483.6893pt x 341.42757pt. -Overfull \hbox (42.84184pt too wide) in paragraph at lines 750--752 +Overfull \hbox (42.84184pt too wide) in paragraph at lines 749--751 [] [] @@ -1158,11 +1158,11 @@ Overfull \hbox (42.84184pt too wide) in paragraph at lines 750--752 File: images/Future_Predictions.png Graphic file (type png) -Package pdftex.def Info: images/Future_Predictions.png used on input line 764. +Package pdftex.def Info: images/Future_Predictions.png used on input line 763. (pdftex.def) Requested size: 512.1362pt x 227.62119pt. -Overfull \hbox (71.28874pt too wide) in paragraph at lines 764--766 +Overfull \hbox (71.28874pt too wide) in paragraph at lines 763--765 [] [] @@ -1171,16 +1171,16 @@ Overfull \hbox (71.28874pt too wide) in paragraph at lines 764--766 File: images/Frontend_Application.png Graphic file (type png) Package pdftex.def Info: images/Frontend_Application.png used on input line 77 -7. +6. (pdftex.def) Requested size: 284.52162pt x 256.07664pt. [48 <./images/Frontend_Application.png (PNG copy)>] File: images/interface_design.png Graphic file (type png) -Package pdftex.def Info: images/interface_design.png used on input line 793. +Package pdftex.def Info: images/interface_design.png used on input line 792. (pdftex.def) Requested size: 227.61479pt x 369.88063pt. [49 <./images/interface_design.png>] [50] -Underfull \hbox (badness 10000) in paragraph at lines 804--806 +Underfull \hbox (badness 10000) in paragraph at lines 803--805 [] @@ -1188,22 +1188,22 @@ Underfull \hbox (badness 10000) in paragraph at lines 804--806 File: lstlang1.sty 2015/06/04 1.6 listings language file ) [51] [52] [53] [54] -Underfull \hbox (badness 10000) in paragraph at lines 954--956 +Underfull \hbox (badness 10000) in paragraph at lines 953--955 [] [55] [56] [57] [58] [59] [60] [61] [62] [63] LaTeX Font Info: Font shape `OMS/cmr/m/n' in size <10> not available -(Font) Font shape `OMS/cmsy/m/n' tried instead on input line 1232. +(Font) Font shape `OMS/cmsy/m/n' tried instead on input line 1231. [64] [65] [66] [67] [68] [69] [70] [71] [72] [73] [74] -Underfull \hbox (badness 10000) in paragraph at lines 1564--1566 +Underfull \hbox (badness 10000) in paragraph at lines 1563--1565 [] [75] [76] -LaTeX Font Info: Try loading font information for T1+cmtt on input line 1628 +LaTeX Font Info: Try loading font information for T1+cmtt on input line 1627 . (/usr/share/texlive/texmf-dist/tex/latex/base/t1cmtt.fd File: t1cmtt.fd 2014/09/29 v2.5h Standard LaTeX font definitions @@ -1211,82 +1211,137 @@ File: t1cmtt.fd 2014/09/29 v2.5h Standard LaTeX font definitions File: images/final_interface.png Graphic file (type png) -Package pdftex.def Info: images/final_interface.png used on input line 1632. +Package pdftex.def Info: images/final_interface.png used on input line 1631. (pdftex.def) Requested size: 398.32816pt x 540.60803pt. [77] [78 <./images/final_interface.png>] [79] [80] File: images/with_sentiment.png Graphic file (type png) -Package pdftex.def Info: images/with_sentiment.png used on input line 1738. +Package pdftex.def Info: images/with_sentiment.png used on input line 1737. (pdftex.def) Requested size: 455.24582pt x 170.71979pt. -Overfull \hbox (14.39836pt too wide) in paragraph at lines 1738--1739 +Overfull \hbox (14.39836pt too wide) in paragraph at lines 1737--1738 [][] [] File: images/without_sentiment.png Graphic file (type png) -Package pdftex.def Info: images/without_sentiment.png used on input line 1746. +Package pdftex.def Info: images/without_sentiment.png used on input line 1745. (pdftex.def) Requested size: 455.22383pt x 170.7181pt. -Overfull \hbox (14.37637pt too wide) in paragraph at lines 1746--1747 +Overfull \hbox (14.37637pt too wide) in paragraph at lines 1745--1746 [][] [] [81] [82 <./images/with_sentiment.png> <./images/without_sentiment.png>] -[83] [84] [85] [86] [87] [88] [89] [90] [91] -Overfull \hbox (40.38213pt too wide) in paragraph at lines 1879--1879 +[83] [84] [85] [86] [87] [88] [89] +Underfull \hbox (badness 10000) in paragraph at lines 1839--1841 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1844--1846 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1849--1851 + + [] + +[90] +Underfull \hbox (badness 10000) in paragraph at lines 1854--1856 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1859--1861 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1864--1866 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1869--1871 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1876--1878 + + [] + +[91] +Underfull \hbox (badness 10000) in paragraph at lines 1881--1883 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1886--1888 + + [] + + +Underfull \hbox (badness 10000) in paragraph at lines 1891--1893 + + [] + +[92] +Overfull \hbox (40.38213pt too wide) in paragraph at lines 1902--1902 \T1/cmr/m/n/12 works,'' To-wards Data Sci-ence, 2018. [On-line]. Avail-able: [] $\T1/cmtt/m/n/12 https : / / towardsdatascience . [] -[92] -Overfull \hbox (83.66737pt too wide) in paragraph at lines 1879--1879 +[93] +Overfull \hbox (83.66737pt too wide) in paragraph at lines 1902--1902 \T1/cmr/m/n/12 works,'' Ma-chine Larn-ing Mas-tery, 2017. [On-line]. Avail-able : []$\T1/cmtt/m/n/12 https : / / machinelearningmastery . [] -Overfull \hbox (28.45175pt too wide) in paragraph at lines 1879--1879 +Overfull \hbox (28.45175pt too wide) in paragraph at lines 1902--1902 \T1/cmr/m/n/12 lem,'' Su-per Data Sci-ence, 2018. [On-line]. Avail-able: []$\T1 /cmtt/m/n/12 https : / / www . superdatascience . [] -[93] -Overfull \hbox (7.75049pt too wide) in paragraph at lines 1879--1879 +[94] +Overfull \hbox (7.75049pt too wide) in paragraph at lines 1902--1902 \T1/cmr/m/n/12 2019. [On-line]. Avail-able: []$\T1/cmtt/m/n/12 https : / / medi um . com / datadriveninvestor / overview -[] [] -[94] -Overfull \hbox (7.25049pt too wide) in paragraph at lines 1879--1879 +[95] +Overfull \hbox (7.25049pt too wide) in paragraph at lines 1902--1902 \T1/cmr/m/n/12 2017. [On-line]. Avail-able: []$\T1/cmtt/m/n/12 https : / / www . statisticshowto . datasciencecentral . [] -Overfull \hbox (9.24751pt too wide) in paragraph at lines 1879--1879 +Overfull \hbox (9.24751pt too wide) in paragraph at lines 1902--1902 \T1/cmr/m/n/12 [On-line]. Avail-able: []$\T1/cmtt/m/n/12 http : / / blog . alej andronolla . com / 2013 / 05 / 15 / detecting -[] [] -Overfull \hbox (0.88026pt too wide) in paragraph at lines 1879--1879 +Overfull \hbox (0.88026pt too wide) in paragraph at lines 1902--1902 []\T1/cmr/m/n/12 P. Cryp-tog-ra-phy, ``A tu-to-rial on au-to-matic lan-guage id en-ti-fi-ca-tion - ngram based,'' [] -[95] [96] +[96] [97] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf used on input line 1884. +Package pdftex.def Info: PID.pdf used on input line 1907. (pdftex.def) Requested size: 597.551pt x 845.07512pt. @@ -1294,7 +1349,7 @@ pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf used on input line 1884. +Package pdftex.def Info: PID.pdf used on input line 1907. (pdftex.def) Requested size: 597.551pt x 845.07512pt. @@ -1304,222 +1359,222 @@ rsion <1.7>, but at most version <1.5> allowed pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page1 used on input line 1884. +Package pdftex.def Info: PID.pdf , page1 used on input line 1907. (pdftex.def) Requested size: 597.551pt x 845.07512pt. File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page1 used on input line 1884. +Package pdftex.def Info: PID.pdf , page1 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. -[97] +[98] File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page1 used on input line 1884. +Package pdftex.def Info: PID.pdf , page1 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page1 used on input line 1884. +Package pdftex.def Info: PID.pdf , page1 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page1 used on input line 1884. +Package pdftex.def Info: PID.pdf , page1 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. - [98 <./PID.pdf>] + [99 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page2 used on input line 1884. +Package pdftex.def Info: PID.pdf , page2 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page2 used on input line 1884. +Package pdftex.def Info: PID.pdf , page2 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) -Package pdftex.def Info: PID.pdf , page2 used on input line 1884. -(pdftex.def) Requested size: 562.1644pt x 795.0303pt. -[99 <./PID.pdf>] - -pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve -rsion <1.7>, but at most version <1.5> allowed - -File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page3 used on input line 1884. -(pdftex.def) Requested size: 562.1644pt x 795.0303pt. -File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page3 used on input line 1884. -(pdftex.def) Requested size: 562.1644pt x 795.0303pt. -File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page3 used on input line 1884. +Package pdftex.def Info: PID.pdf , page2 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. [100 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page4 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page3 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page4 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page3 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page4 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page3 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. [101 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page5 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page4 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page5 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page4 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page5 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page4 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. [102 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page6 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page5 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page6 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page5 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page6 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page5 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. [103 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page7 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page6 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page7 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page6 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page7 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page6 used on input line 1907. (pdftex.def) Requested size: 562.1644pt x 795.0303pt. [104 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page8 used on input line 1884. -(pdftex.def) Requested size: 795.0303pt x 562.1644pt. + +Package pdftex.def Info: PID.pdf , page7 used on input line 1907. +(pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page8 used on input line 1884. -(pdftex.def) Requested size: 795.0303pt x 562.1644pt. + +Package pdftex.def Info: PID.pdf , page7 used on input line 1907. +(pdftex.def) Requested size: 562.1644pt x 795.0303pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page8 used on input line 1884. -(pdftex.def) Requested size: 795.0303pt x 562.1644pt. + +Package pdftex.def Info: PID.pdf , page7 used on input line 1907. +(pdftex.def) Requested size: 562.1644pt x 795.0303pt. [105 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page9 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page8 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page9 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page8 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page9 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page8 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. [106 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page10 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page9 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page10 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page9 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page10 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page9 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. [107 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page11 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page10 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page11 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page10 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page11 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page10 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. [108 <./PID.pdf>] pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve rsion <1.7>, but at most version <1.5> allowed - + File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page12 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page11 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page12 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page11 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. File: PID.pdf Graphic file (type pdf) - -Package pdftex.def Info: PID.pdf , page12 used on input line 1884. + +Package pdftex.def Info: PID.pdf , page11 used on input line 1907. (pdftex.def) Requested size: 795.0303pt x 562.1644pt. [109 <./PID.pdf>] -Package atveryend Info: Empty hook `BeforeClearDocument' on input line 1889. - [110] -Package atveryend Info: Empty hook `AfterLastShipout' on input line 1889. + +pdfTeX warning: /usr/bin/pdflatex (file ./PID.pdf): PDF inclusion: found PDF ve +rsion <1.7>, but at most version <1.5> allowed + +File: PID.pdf Graphic file (type pdf) + +Package pdftex.def Info: PID.pdf , page12 used on input line 1907. +(pdftex.def) Requested size: 795.0303pt x 562.1644pt. +File: PID.pdf Graphic file (type pdf) + +Package pdftex.def Info: PID.pdf , page12 used on input line 1907. +(pdftex.def) Requested size: 795.0303pt x 562.1644pt. +File: PID.pdf Graphic file (type pdf) + +Package pdftex.def Info: PID.pdf , page12 used on input line 1907. +(pdftex.def) Requested size: 795.0303pt x 562.1644pt. +[110 <./PID.pdf>] +Package atveryend Info: Empty hook `BeforeClearDocument' on input line 1912. + [111] +Package atveryend Info: Empty hook `AfterLastShipout' on input line 1912. (./document.aux) -Package atveryend Info: Executing hook `AtVeryEndDocument' on input line 1889. -Package atveryend Info: Executing hook `AtEndAfterFileList' on input line 1889. +Package atveryend Info: Executing hook `AtVeryEndDocument' on input line 1912. +Package atveryend Info: Executing hook `AtEndAfterFileList' on input line 1912. Package rerunfilecheck Info: File `document.out' has not changed. (rerunfilecheck) Checksum: 1D7B2504DFF5D56ABCCDF1948D08498A;14207. @@ -1528,9 +1583,9 @@ Package logreq Info: Writing requests to 'document.run.xml'. ) Here is how much of TeX's memory you used: - 25153 strings out of 492982 - 396371 string characters out of 6134895 - 1018656 words of memory out of 5000000 + 25154 strings out of 492982 + 396379 string characters out of 6134895 + 1018599 words of memory out of 5000000 27463 multiletter control sequences out of 15000+600000 21245 words of font info for 60 fonts, out of 8000000 for 9000 1141 hyphenation exceptions out of 8191 @@ -1553,10 +1608,10 @@ ic/cm-super/sfrm0600.pfb> -Output written on document.pdf (110 pages, 2428026 bytes). +Output written on document.pdf (111 pages, 2433743 bytes). PDF statistics: - 2185 PDF objects out of 2487 (max. 8388607) - 1988 compressed objects within 20 object streams - 888 named destinations out of 1000 (max. 500000) + 2191 PDF objects out of 2487 (max. 8388607) + 1993 compressed objects within 20 object streams + 889 named destinations out of 1000 (max. 500000) 855 words of extra memory for PDF output out of 10000 (max. 10000000) diff --git a/document.pdf b/document.pdf index bf3111e..627501c 100644 Binary files a/document.pdf and b/document.pdf differ diff --git a/document.synctex.gz b/document.synctex.gz index 9bc293a..e10356f 100644 Binary files a/document.synctex.gz and b/document.synctex.gz differ diff --git a/document.tex b/document.tex index 7709f9c..526f5c0 100644 --- a/document.tex +++ b/document.tex @@ -99,11 +99,10 @@ \title{Opinion Mining and Social Media Sentiment Analysis in the Prediction of Cryptocurrency Prices} -\date{Submission date: Place Holder} +\date{Submission date: 29-04-2019} \author{Student: Andrew Sotheran \\Student Number: fr005432 - \\Supervisor: Kenneth Boness - \\Word Count: Place Holder} + \\Supervisor: Kenneth Boness} \begin{document} @@ -1837,41 +1836,65 @@ def create_sets(self, data, lookback, sentiment): \subsection{Future Improvements} + Due to the time frame for the project's development and if more time was presented for development of this project, there would a number of improvements and festure that would be both improved upon and developed for the system. The features listed in this section were both considered thought about throughout development of the project, most of which relate to comparisions on accuracy of the chosen solution over another algorithm or improvements to improve said accuracy of predictions both price and for sentiment analysis. + \newline + \textbf{Comparision of Neural Network Models} + This feature would be to create multiple neural networks such as standard RNNs, feed-forward neural networks, Gated Recurrent Unit (GRU) RNN, Deep Convolutional Network (DCN), Deep Residual Network (DRN) and Support Vector Machine (SVN), to name a few other neural networks, to identify if the chosen LSTM solution performs better than those listed above. The primary goal of this comparison is to continuously identify a more suitable network for the problem this project has aimed to solve. + \newline + \textbf{Comparison and affect of different Optimisers} + A feature to compare the accuracy of the Adam optimiser that is currently implemented compared to RMSProp or Adagrad. Although identified as being a continuation and improvement of those two optimisers it would be interesting how the others perform. + \newline - as such comparing recurrent neural network models, implementation and the affect of regularisation techniques, use of different optimisers would have on the network, how use of ngrams could be used to improve language detection, comparing hand-coded naive bayes model to that of scikit-learns in built classifiers, alterations and additions to the VADER lexicon to tailor it with domain specific language and relevant weighted sentiment values + \textbf{Ngrams for Language Detection} - Interesting what would a days prediction would show due to sentiment not directly affecting the next hour price + As stated in \cite{langdectNLTK} \textit{"There are others ways to “guess” language from a given text like N-Gram-Based text categorization"} and based on previous assumption on the Ngram concept it would be interesting how this could be implemented and how it performs compared to the current solution. + \newline - Shifting the predicted data by and hour and sequencing over previous data - will also allow proper use of look-back windows + \textbf{Hand-coded Naive Bayes Vs Scikit-Learns multiple in-built models} - Another could be to predict the hour of sentiment and create a threshold for it. + Due to hand-coding the Naive 'multinomial' Bayes classifier and using techniques such as Addictive Smoothing, an implementation of a pre-existing form of the algorithm from the Scikit-learn Python package may perform better than the classifier that was coded. Additionally, there are multiple variations of the Naive Bayes classifier such as; Gaussian, Complement and Bernoulli Bayes models, and would be interesting how these each performed against each other and the version coded in the system. + \newline - Identify whether or not use of ngrams improved accuracy of spam classification + \textbf{VADER Lexicon tailoring with Domain Specific Language} - Identify whether use lemmatisation would change how spam classification occured + Due to VADER being a lexicon-based approach to sentiment analysis, and that the lexicon is open-source this allows it be added or altered. Thus a new lexicon tailored to a specific topic domain, containing domain specific langauge could improve the accuracy of polarity classification for the data presented. However this in itself would be a considerable undertaking to identify which weighted sentiment values should be assigned to each new words added. + \newline - Look into use of other ngrams for use with language detection + \textbf{Lemmatisation Vs Stemming} - Compare Scikit-learns in-built naive bayes algorithms and other variations performance for spam filtering against hand-coded version + Another feature and comparision could be made, as discussed in the implmentation of the spam filter, between how lemmatisation could out perform stemming and could possibly improve the accuracy of the spam classifier. + \newline - Look into adding to the VADER lexicon for increasing performance and accuracy for topic domain of stock market language and what sentiment would be assigned to words + \textbf{Retraining of network \& Prediction of next hour sentiment} - IMPLEMENT AND IDENTIFY R2 stat and Mean Bias ERROR + The current solution for price forecasting only uses the trained model to predict the next hour price of Bitcoin, which is trained on a batch size of 1000 samples. Retraining the network each hour with the current live data could improve the accuracy of the predictions further. This could be conducted based on the threshold set in the system, in which if the predicted value is outside of the threshold of the actual value the network is retrained. - (R2 and mean bias error would be suitable metrics to show how conservative the model is and the difference between the predicted and true price it is) - never got to implement + This is a feature similar to the above on retraining the neural network if the price is out of a certain threshold to the actual hourly price. The same could be conducted for the sentiment per hour; however, it would also require the sentiment to be predicted for each hour too. The aim of these two features is an attempt to make the network less conservative and to be able to handle price and sentiment spikes more adequately. + \newline - mean bias Error + \textbf{Implement $R^2$ Statistic and Mean Bias Error} - k-fold cross validation was attempted, but issues with continuous data - How would this work what will it show or validate? + As this was not implemented as metrics for the network, and as described in the previous sections, could show a better correlation between the two models at a metric level. + \newline - How would changing epoch and batch size affect performance? + \textbf{K-Fold Cross-Validation} + + Cross-Validation can be used to assess the predictive performance of a regression model to judge how a model performs outside of the sample training dataset to a new test dataset, in this case, the neural network, and would aid in analysing the correlation between the two models - with and without sentiment. + \newline + + \textbf{Affect of changing Epoch and Batch Size may have} + + This would be an investigation into how the predictive performance could be affected by changing the epoch size along with the batch size. This is aimed to identify the most suitable values for these two parameters for the data used in training the neural network. + \newline + + \textbf{Interface - Charting Library and extension} + + An improvement that could be conducted would be to improve the user interface to make it suitable to be a production ready system that will aid in investor decision making. Currently, as previously described, it is very basic in design and could be improved. Additionally, a different charting library could be used or the bug in which scrolling on different amounts of data using the range scale on each graph which skews both true and predict lines should be looked into. - Use a different charting system as the plotted lines seem to jump around and skew accuracy \newpage \nocite{*} diff --git a/document.toc b/document.toc index deb50cf..0c6c41b 100644 --- a/document.toc +++ b/document.toc @@ -170,8 +170,8 @@ \defcounter {refsection}{0}\relax \contentsline {subsection}{\numberline {14.2}Future Improvements}{90}{subsection.14.2} \defcounter {refsection}{0}\relax -\contentsline {section}{\numberline {15}Appendices}{97}{section.15} +\contentsline {section}{\numberline {15}Appendices}{98}{section.15} \defcounter {refsection}{0}\relax -\contentsline {subsection}{\numberline {15.1}Appendix A - Project Initiation Document}{97}{subsection.15.1} +\contentsline {subsection}{\numberline {15.1}Appendix A - Project Initiation Document}{98}{subsection.15.1} \defcounter {refsection}{0}\relax -\contentsline {subsection}{\numberline {15.2}Appendix B - Log book}{110}{subsection.15.2} +\contentsline {subsection}{\numberline {15.2}Appendix B - Log book}{111}{subsection.15.2}