AI Researcher

22/06 - DNNs + Algebraic Geometry

• Decided to switch to algebraic geometry from algebraic topology, kinda. I realised something I wasn't considering before with topology and was trying to find a solution. It seems like geometry is a lot more powerful for the things I want to do anyway. I still don't fully understand what algebraic geometry studies from heart but i know that its to do with solving polynomial equations. So i bought like 5 books to commit to algebraic geomtry. Its kind of sick because since its algebraic it means i can also use any other fields that are also algebraic like topology while in algebraic geometry land. Even combinatorics, category theory, blah blah blah.
• For the past few days I've been jotting down ideas, formalising my mutating AI even further. Each day i get a lot closer as my math intuition builds stronger. I wrote down high level in math terms how the mutation algorithm will work and have been exploring fully automated goal creation and automated reward assignmnent to make the AI fully automated. The latter is extremely hard, but tbf i haven't put a ton of thought into it. After learning about RL for around 100 pages in Suttons book I've learned so much. I knew that if I started learning about the math behind AI properly then I would get a lot better intuition for how to improve current bleeding edge and create my own niche paradigm -- and I was correct! Learning so much, and i actually understand it all too.
• Been also going deeper into deep neural nets as well, writing an article as i learn to solidify my understanding. It's not as difficult as i initially thought. But the math makes a lot of sense. Im just finialising my understanding of the forward pass and backprop with an explicit explaination of the chain rule to train w/ the cost gradient for gradient descent. I also learned what dropout is mathematically.
• Even more wild was I woke up to an openAI researcher cold DM me to contribute to a publication with my ideas on adaptive self preserving AI. Good to know eyes are on me now and i should be careful with what i say, idea wise.
• The day im writing this i feel very "off". Burnt out it seems. Maybe because i got 6hrs sleep? The morning was really good but then i crashed so hard and basically lost the day. I really want snacks but i find it hard to buy them irl since i do this cost tradeoff between steak and snacks and always get steak...But then i get home and am like "i dont have anything to snack on wtf" and just eat canned tuna and feel sad. Either way, im making great progress in my AI journey and definitely am on track to learning all the models from CNN, RNN, GAN, diffusion and transformers by end of year. I hope to say evolutionary DNN and deep Q-networks too, but we'll see. 6 months left, i think i can definitely do it. i feel really confident that i could get a job, if i wanted to in AI, by end of year. especially with the release of these articles explaining it from scratch WITH CODE alongside the math as implementation. i also cant believe how computationally inefficient doing all these calculations for DNN is. Its absolutely fucked! no wonder these companies spend retarded money on GPUs and training. its just fucked overall. someone needs to come along and just make it better cough COUGH. i honestly think AI R&D is going to be so easy to create a skill gap because it seems gate kept for people that like math and engineering but then majority of these people are "normies" in terms of creativity and expressing ideas. unsurprisingly i find this at every intellect level! free real-estate.
• Just deciding on whether i fly to portugal too for a lil meetup with friends. 30hr flight, $3k AUD and a lil war going on in the middle east (which i need to fly by) and i dont want to get locked out of my country again like covid. Idk, decisions, decisions...
• I think ive also exhausted my focus too. I had such diehard drive this week and today it all burnt out, probably bc of the sleep and i got a rash on my face probably from stress destroying my immune system so that doesn't help. Then the rash healed and another one popped up as the other just healed, like wtf dude. But in the grand scheme of things career progress is great. Personal progress is...lacking? idk. I also feel the back left of my brain throbe with migraines every once in a while. Actually, as i write this i feel some electrico-chemistry going on near the top center of my brain. Some days it just kinda shocks me and i squint my left eye. I dont think this is normal? Ive been taking ashwagandha, but maybe i should take 800mg instead of 400mg per day. My diet is decent, still making beef stew with carrots and potatoes and occasionally minced meat with rice and turmeric. No veggies though :/ maybe thats where im going wrong? mmmm...
• Ive also been daily driver'ing void linux instead of my macbook too! ive gotten used to the shitty speakers. I haven't figured out how to make the macbook speakers compatable yet. but overall its been quite good. and since im worried about the security on it i find myself doing less addicting things. and speaking on addiction: im trying to cut back and go cold turkey on some things before i turn 25 since the brain isnt as plastic past 25 bc it finishes growing, then plasticity is much slower! so im trying to get rid of the bad things within a year to hopefully make it easier to quit. maybe thats why my focus is so shot?
• everyones been kind of doing their own thing and shitting themselves about usa bombing iran and whatnot so haven't been talking to anyone much either lately. dont feel terribly lonely but today i found myself scrambling for dopamine on x.com and just always checking my phone screen turning it on, even going across the house to check. must be a bad day today emotionally? i went to the gym and was so tired i think i almost fainted after deadlifts. its like my mind is going to shut down. even lying on the pillow hurt the back of my head because i was lying all day :(. I find myself really full from eating (healthy) food but have this craving to still eat despite being literally full. my brain is really scattered searching for some dopamine to grab onto today. i think im just doing to stand in a boiling shower for a bit then knock out