|
40 | 40 | <meta name="twitter:domain" content="procstack.github.io">
|
41 | 41 | <meta name="twitter:label1" content="Written by">
|
42 | 42 | <meta name="twitter:data1" content="Kevin Edzenga">
|
43 |
| - |
44 |
| - |
45 | 43 | </head>
|
46 | 44 |
|
47 | 45 | <!-- -- -- -- -->
|
|
367 | 365 | <br><br>Outside of that, I'm on'n'off working on <span class="textNudge">Graph Attention Network</span> artificial intelligence.
|
368 | 366 | <div class='gitPageAboutMeSpacer'></div>
|
369 | 367 | I've been working on a general-purpose neuron that adjusts its own connections during prediction.
|
370 |
| - <br>I call it a "model-less" ai network, even though the model is just dynamically generated based on input data. |
| 368 | + <br> I call it a "model-less" ai network, even though the model is just dynamically generated based on input data. |
371 | 369 | <br>It's the Structure which derives regions of neural activation based on stimuli, like the Butterfly Effect echoing through nature.
|
372 |
| - <br>Forming a result <span class="textDrinkMeAlice">(prediction)</span> after subsiquent activations, as-though compounding ripples in a pond. |
| 370 | + <br> Forming a result <span class="textDrinkMeAlice">(prediction)</span> after subsiquent activations, as-though compounding ripples in a pond. |
373 | 371 |
|
374 | 372 | <br><br>Rather than a grid of numbers aligning to yield a prediction, it's a data structure which outputs a value due to the neuron connections.
|
375 |
| - <br>Realistically, the output should be similar to a RNN, but with a different mental structure. |
| 373 | + <br> Realistically, the output should be similar to a RNN, but with a different mental structure. |
376 | 374 |
|
377 | 375 | <br><br>
|
378 | 376 | <div class='gitPageAboutMeInfoStyle'>
|
|
381 | 379 | <br>But could be used for so much more!
|
382 | 380 | </div>
|
383 | 381 |
|
384 |
| - <br><span class="innerCenter">So all this new AI stuff has been quite serendipitous for me!</span> |
385 |
| - <img src='https://www.pxlmancer.com/show/esnLearning.gif' class='gitPageImageStyle' alt='Frank the Fish on his Pinky Flamingotube!' > |
386 |
| - <span class="imageDesc innerCenter">Not a graph network, but an ESN (a RNN variant) I wrote to detect & predict motion. |
387 |
| - <br>Upper left are some videos I made, upper right are it's 'levels' of learning R-G-B, |
388 |
| - <br>The bottom two are slices of what the brain is seeing, and then predicting.</span> |
389 |
| - |
390 |
| - <br><br>There has been some advancements in Graph Neural Networks (GNNs), but not quite what I'm looking for in how the neurons are structured, or that I've seen yet. |
391 |
| - <br>Intrinsic learning dang it! That meta-learning to help with the learning of the learning! |
| 382 | + <br><span class="innerCenter">So, all this new AI stuff has been quite serendipitous for me!</span> |
| 383 | + |
392 | 384 |
|
393 |
| - <br><br>Eh, I'm rambling now... |
| 385 | + <br><br><span class="innerCenter">How about an ESN AI I wrote in the summer of 2024? |
| 386 | + <br>An ESN or Echo State Network is a type of Recurrent Neural Network (RNN) which considers time in it's prediction. |
| 387 | + <br>It thinks about past events to predict future events. |
| 388 | + <div class='gitPageAboutMeSpacer'></div> |
| 389 | + Since the brain learns on the fly, why not feed it some videos I made? |
| 390 | + </span> |
| 391 | + <div ll-src='https://pxlmancer.com/show/esnLearning.gif' ll-thumb='https://pxlmancer.com/show/esnLearning_th.png' ll-width='320' ll-height='320' class='lazyLoad gitPageImageStyle' alt='ESN Horizontal-Vertical Slice'></div> |
| 392 | + <span class="innerCenter">Upper left are some videos I made, upper right are it's 'levels' of learning R-G-B, |
| 393 | + <br>Where red are known patterns, green are the edges of the patterns, and blue are the "less likely" patterns. |
| 394 | + <div class='gitPageAboutMeSpacer'></div> |
| 395 | + Then on the bottom are two slices of the patterns the brain thinks its seeing and then predicting.</span> |
| 396 | + |
| 397 | + <br><br> |
| 398 | + <div ll-src='https://pxlmancer.com/show/learningGradients_84_opt.gif' ll-thumb='https://pxlmancer.com/show/learningGradients_84_th.jpg' ll-width='320' ll-height='320' class='lazyLoad gitPageImageStyle' alt='ESN Brain Wrinkling'></div> |
| 399 | + <span class="innerCenter">A different slice & settings for the same ESN I wrote. |
| 400 | + <div class='gitPageAboutMeSpacer'></div> |
| 401 | + Upper left is another video I made the AI is watching, upper right is the brain's prediction, |
| 402 | + <br>Lower left is a slice of the brain's learned wrinkles, lower right the brain's prediction. |
| 403 | + |
| 404 | + <br><br>With a "reservoir" of 15 times steps, you'll notice about every 15 frames the brain shifts. |
| 405 | + <br>By frame ~45, it's learned some patterns |
| 406 | + <br>The brain seems to then melt and rebuild itself to be predicting by frame ~70. |
| 407 | + |
| 408 | + <br><br>It should be happenstance that the brain shifts when the reservoir fills, |
| 409 | + <br>Could mean I'm not correctly accounting for high p-values, outliers; |
| 410 | + <br>But it's detecting patterns in motion!</span> |
| 411 | + </span> |
| 412 | + |
| 413 | + <br><img src='https://www.pxlmancer.com/show/learningGradients_84_brainSlice.png' class='gitPageImageStyle' alt='Custom ESN Learning Gradients' > |
| 414 | + <span class="innerCenter">A slice of the ESN's brain by frame 101 of watching the X pattern video.</span> |
| 415 | + |
| 416 | + <br><br>If you couldn't tell by now, I'm training my AIs on my own creations. |
| 417 | + <br>A personally made AI trained on personally made images / videos / photos / code / writing training data. |
| 418 | + <br> That means I can copyright my generations, right? |
| 419 | + <br> If I made every aspect of the AI and training data? |
394 | 420 | <br><br>
|
395 | 421 | </div>
|
396 | 422 | <div class="gitPageInnerAfter"></div>
|
|
414 | 440 |
|
415 | 441 | <canvas id="pxlNav-coreCanvas" height='1' width='1' class="pxlNavCoreCanvasStyle" ></canvas>
|
416 | 442 |
|
417 |
| - <script type="module" src="js/ProckStackGitio.js?v=2024-12-28"></script> |
| 443 | + <script type="module" src="js/ProckStackGitio.js?v=2024-12-30"></script> |
418 | 444 |
|
419 | 445 |
|
420 | 446 | </body>
|
|
0 commit comments