{'fraction_non_alphanumeric': 0.030021967293141324, 'fraction_numerical': 0.005125701732975348, 'mean_word_length': 4.724550898203593, 'pattern_counts': {'":': 0, '<': 2, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 3, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Application and Computation of Probabilistic Neural Plasticity

The discovery of neural plasticity has proved that throughout the life of a human being, the brain reorganizes itself through forming new neural connections. The formation of new neural connections are achieved through the brain's effort to adapt to new environments or to changes in the existing environment. Despite the realization of neural plasticity, there is a lack of understanding the probability of neural plasticity occurring given some event. Using ordinary differential equations, neural firing equations and spike-train statistics, we show how an additive short-term memory (STM) equation can be formulated to approach the computation of neural plasticity. We then show how the additive STM equation can be used for probabilistic inference in computable neural plasticity, and the computation of probabilistic neural plasticity. We will also provide a brief introduction to the theory of probabilistic neural plasticity and conclude with showing how it can be applied to multiple disciplines such as behavioural science, machine learning, and psychiatry.


Introduction
Changes in the functionality and development of the brain has and continues to be an ongoing discussion and research within the neuroscience, psychology, artificial intelligence, cognitive science, and psychiatric community. Discoveries about the brain have led to major realizations about it, shifting how we act, learn, perceive and approach situations and circumstances. The realization of neural plasticity is one of those realizations about the brain that created a drastic shift in our understanding of the brain as it showed us that the development of the brain does not stop at adulthood; rather it continues to change throughout a person's entire life. In other words, changes to the brain can take place from infancy to adulthood.
While the realization took place many years later, the use of it took place in the 20th century by neuroscientist and pathologist Santiago Ramón y Cajal. He described neuronal plasticity as the nonpathological changes in the structure of the brain of an individual (Fluchs, and Flügge, 2014). Arguments and evidence overtime proved the existence of neural plasticity, leading to the current debates and discussions that we have about it today. Understanding the probability of neural plasticity occuring given some event is a topic of interest, but has not been adequately covered or discussed. To contribute to this discussion, we will propose and briefly introduce the theory of probabilistic neural plasticity, then derive a short-term memory (STM) equation that can be used for the computation of probabilitistic neural plasticity, elaborate how the STM equation can be used for probabilistic inference in computable neural plasticity. We will conclude a discussion on the application of probabilistic neural plasticity in areas such as behavioral science, machine learning, and psychiatry.
In understanding changes within the brain, we define several terms within neuroanatomy. Neurons are the cells within the nervous system that communicate with each other to transmit information to other nerve cells, muscles, or gland cells. Neurons generally contain an axon, a cell body, and dendrites. The cell body contains the nucleus and cytoplasm. The axon is part of the cell body, extending from the cell body to the nerve terminals. They often create smaller branches prior to ending at the nerve terminals. Dendrites extend from the cell body and receive messages from other neurons within the brain. They are composed synapses formed by the ends of the axon from other neurons.

Synapses
Synapses are the spaces found within the brain cells (Bate, and Bassiri, 2016). Historically synapses were generally understood to carry the role of transferring information between one neuron to another through connecting them together. However, it was later discovered that the efficacy of synaptic transmission is not constant; that it varied depending on the frequency of the stimulation, and the modulation of synaptic frequency provoked modifications of neural connections in volume, size and shape (Bate, and Bassiri, 2016). In other words, those connections that are frequently stimulated will increase in volume and size, resulting in a change in shape. Consequently, inactive connections decrease in size and volume, resulting in synaptic long-term depression. The creation of synapses is known as synaptic formation and elimination of synapses is known as synaptic pruning. While synaptic formation and pruning occur extensively during the early stages of brain development (i.e. embryonic brain stage), synaptic formation and pruning takes place throughout until the end stages of brain development (i.e. adult brain). The adult brain continues to create synapses and eliminate unwanted synapses over the course of our life in response to our actions do and experiences, playing important roles in learning, memory, and other aspects of the functioning of our brain. Such evolution of nervous systems enables us to adapt to environments and determine the optimal action in any given situation based on what was learned from our past experiences (Constandi, 2016). As a result, synapses have their efficacy reinforced or weakened as a function of experience. The occurrence of modulation of synaptic frequency provokes modifications of neural connections in volume, size and shape is known as neural neural plasticity, synaptic plasticity, or neuroplasticity.

Stimuli
Stimuli are defined as events or occurences in the environment of an organism that influences its behavior. In general, neurons responding to sensory stimuli face the challenge of encoding parameters that can vary over a vast dynamic range (Dayan, and Abbott, 2001). To address such wide-ranging stimuli, sensory neurons often respond most strongly and rapid changes in stimulus properties and are relatively insensitive to steady-state levels. Mathematically, the functions of stimulus intensity are typically with logarithmic or weak power-law dependence (Dayan, and Abbott, 2001).

Plasticity
The term plasticity can be defined as a structure that is weak enough to submit to influence, but strong enough to not submit to all influence at once (Constandi, 2016). From this definition, if we consider the brain as a structure, the term neural plasticity can be understood as influences causing a modification of neural connections with changes occurring over a specific span of time. The type of plasticity that we are concerned with is functional plasticity. Functional plasticity involves changes in some physiological aspect of nerve cell functions such as frequency of nervous impulse or the probability of release of chemical signals -both of which act to make synaptic connections either stronger or weaker, resulting in changes to the degree of synchronicity among populations of cells. All types of plasticity that the brain can undergo enables the brain to learn from experience in order to form memories and acquire new skills, and also allows for adaptation and recovery from brain trauma, or at least to compensate for and work around any damage that has occurred. Consequently, the relationship between brain and behavior is not one-sided -experiences and behaviors induce plastic changes in the brain, which these changes can influence our future behavior and experiences (Constandi, 2016).

Probabilistic neural plasticity
Within plasticity, the way that probability is involved comes from the influence. More specifically, when we consider a structure that is weak enough to submit to influence, but strong enough to not submit to all influence at once, there are two probabilities that can be discussed. The first probability that can be discussed is the probability that the influence can cause a structure to be influenced. The second probability that can be discussed is the probability that a structure is strong enough to not submit to all influence at once. This tells us that probability plays a major role in neural plasticity. Through understanding the role that it plays in neural plasticity, we can understand the chance of neural plasticity occuring given some event. To comprehend the probability that of neural plasticity occuring given some event, we define and refer to the theory of probabilistic neural plasticity.
Theorem 1: Probabilistic neural plasticity is the probability that specific effects are due to causes that are defined by variations of neural connections formed by the brain from adapting to its environment.
In this context, effects are either a behavioral condition or a mind condition. The environment consists of not only the physical environment, but also events, situations and circumstances. For instance, a traumatic event can be considered as an environment which can cause the brain to undergo neurological changes needed for it to adapt to the traumatic event. Alternatively, an environment can also be a data set as a data set used for training and testing the machine learning algorithm can influence the behavior and performance of the algorithm. What can be noticed about probabilistic neural plasticity is that its application can be found in both human learning and in machine learning. We will further discuss about its application after discussing the computational components associated with probabilistic neural plasticity and the computation of probabilistic neural plasticity.
To perform the computation of probabilistic neural plasticity, we must formulate computational and mathematical models using theories and concepts from areas such as theoretical neuroscience, mathematics, and computer science. Furthermore, probabilistic inferences can be made through the computational aspect of neural plasticity. Moving forward, we will discuss and elaborate on the computation of neural mechanisms, covering neural state equations, neural firing, spike-train statistics, and the neural plasticity equation. We will then discuss about probabilistic inference in computable neural plasticity followed by the computation of probabilistic neural plasticity.

Computable neural mechanisms and equations
In approaching the computation of neural mechanisms and the computation of neural plasticity, we will describe a computational model of neural systems. More specifically, we will describe the computational model of neuron states, neural firing, and spike-train statistics. Between physiological, psychological and neurological approaches, while the computational (and mathematical) modeling can be done using any one of those approaches, we will be approaching neural mechanisms and neural plasticity solely through a neurological approach. In using theoretical neuroscience and additive short-term memory (STM) equation, we will formulate the neural plasticity equation and a computational model for neural plasticity.

Neural state equations
The computational and mathematical model of neuron states can be written as neuron state equations. Assume a neuron interacting with other neurons and external stimuli. Let v i be defined as the i th neuron. Let x i and w i be defined as the variable that describes the neuron's state. Let τ be defined as time interval. Then the one state variable of v i is x i where x i is denoted as the activation level of the i th neuron. The second state variable, w i , is associated with v i 's interaction with v j 's (another neuron). Using additive STM equation we formulate the set of ordinary differential equations for x i and w i . Assume a change caused by internal and external processes in neuron potential from equilibrium, and that inputs from other neurons and stimuli are additive (agrees with many experiments). Then for all i = 0, 1, 2, . . . , n, the additive STM equation is The additive STM equation is the ∆x i neuron state equation that describes the activation level of x i with respect to internal, excitatory, inhibitory and stimuli. We will describe neural firing through the relationship between stimulus and firing-rate, and we will address the internal ordinary differential equation, excitatory ordinary differential equation, inhibitory ordinary differential equation, and stimuli ordinary differential equation. We will then formulate the neural plasticity equation needed for the computation of probabilistic neural plasticity.
To obtain the internal ordinary differential equation in the additive STM equation, we assume that the neuron processes are stable. In doing so, this provides us the internal ordinary differential equation A is denoted as the learning rates for the potentiation.
For the inhibitatory ordinary differential equation in the additive STM equation, it can be obtained through the change in the neuron's state. With w i being defined as the variable that describes the neuron's state, the change in the neuron's state can be described using ∆w i . To obtain the equation for ∆w i , we can make use of existing mathematical models. A mathematical model that we can make use of is the mathematical model Bi-Phasic Spike Timing Dependent Plasticity (Bi-Phasic STDP). Bi-Phasic STDP consists of two phases. The first phase is a depressive phase in which presynaptic spike follows post-synaptic spike. The second phase is a potentiating phase in which a post-synaptic spike follows pe-synaptic spike (Chrol-Cannon, and Jin, 2014). The Bi-Phasic STDP model is In the model, A + is denoted as the learning rates for the potentiation and Ais denoted as the learning rates for the depression, ∆t i is denoted as the delay of the post-synaptic spike occurring after the transmission of the pre-synaptic spike, and τ + and τcontrols the rates of the exponential decrease in plasticity across the learning window. Using the Bi-Phasic STDP model, we obtain the inhibitory ordinary differential equation which

Stimulus
To recall, when neurons encounter wide-ranging stimuli, sensory neurons often respond most strongly and rapid changes in stimulus properties and are relatively insensitive to steady-state levels. Steady-state responses are highly compressed functions of stimulus intensity. Let s be denoted as a stimulus. Applying Weber's law tells us that when we differentiate between the intensity of two stimuli, ∆s is proportional to the magnitude of s, resulting in ∆s/s being constant. In terms of adaptation, sensory systems make many adaptations, using a variety of mechanisms to adjust to the average level of stimulus intensity (Dayan, and Abbott, 2001). When a stimulus generates such adaptation, describing responses to fluctuations about a mean stimulus level is an ideal way of comprehending the relationship between the stimulus and the response (Dayan, and Abbott, 2001). In this case, s(t) be defined such that its time average over the duration of a trial is 0. Then, we find that We can now use two approaches that we can use to progress in analyzing stimulus. The first approach would be to use several different stimuli and averaging over them. The second approach is putting all the stimuli that we wish to consider into a single time dependent stimulus sequence and average over time. We will use the second approach, replacing stimulus averages with time averages. To make the stimulus periodic, for any time τ , we define the stimulus outside the time limits of the trial by the relation s(T + τ ) = s(τ )

Neural firing
For neural firing, we define spike-triggered average stimulus as C(τ ), where C(τ ) is denoted as the average value of the stimulus a time interval τ before a spike is fired. Mathematically, we define the spike-triggered average stimulus as The approximate equality of the mathematical equation comes from the fact that if n is large, then the total number of spikes on each trial is well approximated by the average number of spikes per trial (Dayan, and Abbott, 2001). Expressing the spike-triggered average stimulus as an integral would be In formulating the stimuli ordinary differential equation in the additive STM equation, we use the approach that consists of placing all of the stimuli that we want to consider into a single timedepeendent stimulus sequence and average over them -replacing stimulus averages with time averages. Then, for any h, the integrals involving the stimulus being time-translationally invariant is Then the stimuli ordinary differential equation is

Spike-train statistics
In approaching the relationship between a stimulus and a response on a stochastic level, we use probability theory to address and approach spike tunes and occurences, and neuronal firing. For spike tunes, as they are continuous variables, the probability for a spike to occur at a specific time is 0. In turn, to obtain a nonzero spike value, we must evaluate the probability that a spike occurs within a specific time interval (Dayan, and Abbott, 2001). Let the probability that a spike occurs in the time interval between times t and t + ∆t. Given such time interbal, the probability P(t 1 ,t 2 , ..., t n ) that a sequence of n spikes occurs with spike i falling between time interval t i and t i + ∆t for i = 1, 2, ..., n is given in terms of density by the relation of P (t 1 , t 2 , ..., t n ) = p(t 1 , t 2 , ..., t n ) (∆t) To obtain an approximation of stochastic neuronal firing, Poisson process can be used as Poisson process entails that events are statistically independent if they are not dependent at all on preceding events (Dayan, and Abbott, 2001). In using Poisson process, we can approach firing process through two separate cases. The first case is a homogeneous process that involves the firing rate being constant over time (Dayan, and Abbott, 2001). In this case, since the firing rate is constant, the Poisson process generates every sequence of n spikes over a fixed time interval with equal probability. Let P T (n) be the probability that an arbitrary sequence of exactly n spikes occurring within a trial of duration T. Let the firing rate for a homogeneous Poisson process be denoted asq(t) = q) (as it is independent of time). Assume that the spike times are ordered. Then 0 ≤ t 1 ≤ t 1 ≤ ... ≤ t n ≤ T and the probability for n spike times is The second case is a inhomogeneous poisson process that involves the firing rate being timedependent (Dayan, and Abbott, 2001). In this case, since the firing rate depends on time, different sequences of n spikes occur with different probabilities. In addition, the probability p(t 1 ,t 2 ..., t n ) depends on the spike times. Using inhomogeneous Poisson process, we find that the spikes are still generared independently, and their times enter p(t 1 ,t 2 ..., t n only through the time-dependent firing rate r(t). Assume that the spike times are ordered. Then 0 ≤ t 1 ≤ t 1 ≤ ... ≤ t n ≤ T and the probability for n spike times is For the excitatory ordinary differential equation in the additive STM equation, we assume additive synaptic excitation proportions to the spike-train frequency. We find that for the excitatory ordinary differential equation, the equation depends on the firing rate and whether it is constant over time or time-dependent. This gives us the ordinary differential equation where if the f iring rate is time − dependent (16)

Neural plasticity equation
Combining all of the ordinary differential equations together, for all i = 0, 1, . . . . n, the neuron state equation is which ρ i and w i are defined with respect to their ordinary differential equations. To compute neural plasticity, we consider all of the activities of the neurons from 1 to n. The activity level that most frequently occurred among all the neurons is the neuron state with has the highest degree of neural plasticity. The neuron state that has the highest degree of neural plasticity therefore has the most influence on the brain, directly contributing to the (plastic) changes occurring inside the brain. The final computational model that can be used for neural plasticity, which we will name the Degree of In the model, we denote ∆w i as the change in synaptic strength; w i as the synaptic strength; A + as the learning rate for the potentiation; Aas the learning rate for the depression; τ + and τas what controls the rates of exponential decrease across the learning window; T as trial; and x i as the activation level of the i th neuron. This establishes the computation of neural plasticity.

Probabilistic inference in computable neural plasticity
With establishing the computation of neural plasticity, we can discuss how probabilistic inferences can be made through the computation of neural plasticity. Probabilistic inference is used to approach probabilistic queries of form P(X|Y ), where Y and Z, are disjoint subsets of X given a graphic model for X. We will go into the construction of the graphical model. Rather, we will directly define a probabilistic query and address the probabilistic queries using probabilistic inference. However, note that a basic graphical model can be constructed using the concept of neuron state equations and the Bi-Phase STDP model. In understanding neural plasticity, our query would be to know what the posterior distribution of degrees of neural plasticity would look like. Let Y be the query variable. Let T be denoted as a time interval [t i , t] with i = 1, 2, ..., n. Let DNP be denoted as the degrees of neural plasticity. The probabilistic query can address using is P (Y |T, DN P ) = P (Y |DN P 1 , DN P 2 , ..., DN P n ) = P [Y |DN P ( T 1 = t 1 ), DN P ( T 2 = t 2 ), ..., DN P ( T n = t n )] This would enable us to obtain the posterior probabilities of degree of neural plasticity. This in turn, can then be used to estimate the posterior distribution with respect to degrees of neural plasticity.

Computation of probabilistic neural plasticity
To recall, the problem that is being answered is what is the probability that event X will cause neural plastic changes to the brain. The answer to that question can be obtained through using probability neural plasticity -the probability that specific effects are due to causes that are defined by variations of neural connections formed by the brain from adapting to its environment. With the DNP model, we can now investigate and analyze how exactly the computation of probabilistic neural plasticity can be achieved. The first thing we will do is formulate the problem in mathematical terms. Let E be denoted as a specific event Let T be denoted as a trial with [t i , t] with i = 1, 2, ..., n. Let DNP be denoted as the degrees of neural plasticity. The problem in mathematical terms would be P(DN P |E, T ). The variable T was added as the time interval must be defined in order to compute the change in synaptic strength. The probabilistic neural plasticity model that would be Since T must always be known, P(T) = 1. For P(DNP), since it relies on trial T, we cannot compute for P(DNP) directly. To address this, we can either assume that P(DNP) = 1 or P(DNP) = 0, which for this case we will always assume that P(DNP) = 1.
Set DNP as the function with respect to trial T. Then which this can be solved using the STM equation. From here, we can compute the probability of whether stimuli S will most likely cause neural plastic changes to the brain. If a high probability is obtained from the computation of P(DN P |S, T ), then that implies that stimuli S will most likely cause neural plastic changes to the brain. If a low probability is obtained from the computation of P(DN P |S, T ), then that implies that stimuli S will not most likely cause neural plastic changes to the brain.

Results
Our theoretical results stems from behavioral science and machine learning. We wish to study the behavior of humans and artificial intelligence (AI), understanding what is the probability of neural plasticity occuring given some event. For humans, the event would be a stimulus, while for artificial intelligence, the event would be data. In both cases, we wish to understand how likely it is for a human or machine learning algorithm to change or develop a new behavior from experiencing some event. Another way of seeing it is that we want to understand how likely it is for a human or machine learning algorithm to change its thought and reasoning process after experiencing some event. The cases presented are not actual cases that have taken place. Rather, they are used to illustrate how probabilisitic neural plasticity can be applied to behavioral science, machine learning, and psychiatry. In addition, it is important to note that while our dicussion focuses on results that involve behavioral science, machine learning and psychiatry, discussion on the results (and even the application of probabilistic neural plasticity) can futher be elaborated, extending and involving other disciplines such as neuroscience and cognitive science.

Behavioral science and psychiatry
Within the context of behavioral science, we consider a case in psychiatry. A patient diagnosed with borderline personality disorder is presented. It is provided that the patient expressed chronic feelings of emptiness, and has a fear of abandonment. In addition, the patient display feelings of anger, but does not provide adequate details about their relationship with their parents, making it difficult to determine whether the cause of the chronic feelings of emptiness and fear of abandonment is due to the patient being neglected, withheld, uncared, or abandoned by the caregivers (American Psychiatric Association, 2013). To determine whether neglect from the parents caused neural plastic changes to the brain of the patient, we apply probabilistic neural plasticity. Let DNP be defined as the degree of neural plasticity with respect to the behavior and feelings presented by the patient (chronic feelings of chronic feelings of emptiness, fear of abandonment, and anger). Let E be defined as the parents action towards the patient, and let T be the time interval. Then the equation (20) becomes P (DN P |E, T ) = P (DN P |Action parents , T ) = P (Action parents |DN P, T )P (T |DN P )P (DN P ) P (DN P |Action parents , T )P (Action parents |T )P (T ) We set the DNP as a function with respect to trial T. Then DN P = M ode([∆x i ]) = M ode([∆x 1 , ∆x 2 , ..., ∆x n ]) (24) Let n be the current age of the patient. We expand equation (16) with ρ i being defined with the firing rate being time-dependent, and ∆t i ≥ 0. Then the equation for i = 1, 2, ..., n, ∆x i is (25) If the probability P(DN P |E, T ) ≥ 0.5, then neglect from the parents caused neural plastic changes to the brain of the patient. If P(DN P |E, T ) < 0.5, then neglect from the parents did not cause neural plastic changes to the brain of the patient.

Machine learning and artificial intelligence
Within the context of machine learning, we consider an artificial neural networks (ANN). An ANN designed to predict the probability that an individual that has committed a crime in the past will commit another crime in the future. We know that the data used to train the ANN was provided by the department of justice of the country. The data included sex (male, female), age at release (18 and older) and race/hispanic origin (white, black/African American, hispanic/latino, others), commitment offense (violent, property, drug, and public order), and recidivism. We also know that based on the data, previously convicted males of age range 18 -29 of race others that commit an offense of violence are most likely to recommit the act of violence. The ANN is being used on a white male, aged 24, that has previously been convicted of violence to determine the probability that that invidivual will commit the same crime again in the next 3 years. The AI (that uses the ANN) predicts that the individual will commit the same crime in the next 3 years. To determine whether the commitment offense data caused neural plastic changes to the ANN to determine whether the individual will recommit the crime in the next 3 years, we apply probabilistic neural plasticity. Let DNP be defined as the degree of neural plasticity with respect to the individual's criminal record. Let E be defined as the criminal offense, and let T be the time interval. Then the equation (20) If the probability P(DN P |E, T ) ≥ 0.5, then the commitment offense in the data caused neural plastic changes to the ANN, resulting in the decision made by the AI on the previously convicted individual. If P(DN P |E, T ) < 0.5, then then the commitment offense data did not cause neural plastic changes to the ANN, resulting in the decision made by the AI on the previously convicted individual.