1200pj: inspecting poisson process #217
hyunjimoon
started this conversation in
iai1-o4s
Replies: 2 comments
-
I asked claudeai to provide the above and it was shocking to know that all literature were hallucinated. so updated above |
Beta Was this translation helpful? Give feedback.
0 replies
-
Q1. three (uniform, overflow, dwell time) vs four types of delay? How they relate to each other? is total delay X1+X2+X3? Q2. fact check of the table on current state of WMATA |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is traffic Poisson? In Unit 2, we extensively make use of the Poisson process, largely because of its analytical properties. But is the real world Poisson? Dig into traffic datasets (e.g. NGSIM, HighD, I-24 MOTION) and report back on what is and isn't Poisson. In particular, this project considers the modeling of various arrival processes in traffic (arrivals to intersections, highway merges, or even just arrivals to any fixed point on the road (e.g., a road sensor), etc.).
Task 1: Mathematical model on how inhomogeneous Poisson becomes homogeneous Poisson using hierarchical Bayesian theory.
We can use hierarchical Bayesian theory to explain the effect of separating sources as decomposing observations whose rate lambda is first sampled from a Gamma distribution (three types: signal delay, dwell delay, overflow delay). Then, the delay rate of each type (lambda1, lambda2, lambda3) is used to generate a Poisson process.
Let's define the model:
Observational model for the data:
$$(Y_i \mid \lambda_i) \sim \text{Poisson}(\lambda_i), \quad i=1, \ldots, k$$ $Y_i$ represents the observed delay for the $i$ -th type (signal delay, dwell delay, or overflow delay), and $\lambda_i$ is the corresponding rate parameter.
where
Structural model for the parameters of the likelihood:
$$(\lambda_i \mid \alpha, \beta) \sim \text{Gamma}(\alpha, \beta), \quad i=1, \ldots, k$$ $\alpha$ and $\beta$ are the shape and rate parameters of the Gamma distribution, respectively.
where
Hyperparameter model for the parameters of the structural model:
$$\alpha \sim \text{Uniform}(0, 0.5)$$
$$\beta \sim \text{Gamma}(0.1, 1)$$
By separating the sources of delay into signal delay, dwell delay, and overflow delay, we are essentially decomposing the inhomogeneous Poisson process into multiple homogeneous Poisson processes, each with its own rate parameter$\lambda_i$ . The hierarchical Bayesian model allows us to account for the uncertainty in the rate parameters by assigning them a Gamma prior distribution, which is a conjugate prior for the Poisson likelihood. The hyperparameters $\alpha$ and $\beta$ are given their own prior distributions to complete the hierarchical structure.
This hierarchical Bayesian approach helps to explain how separating the sources of delay can lead to a more homogeneous Poisson process for each source, as the rate parameters are modeled as being drawn from a common Gamma distribution. The posterior distribution of the rate parameters can be inferred using Bayesian inference techniques, such as Markov Chain Monte Carlo (MCMC) methods.
Task 2: Five representative references that assume a Poisson process (exponential interarrival time).
Five papers that assume a Poisson process (exponential interarrival time) and are relevant to transportation:
"Impact of Variability of Interarrival and Service Times"¹. This paper analyzes the influence of the distributions of some input parameters of the models on the Response times. It applies different distributions to the Interarrival times of requests keeping the distribution of Service times fixed.
"15.1: Introduction - Statistics LibreTexts"². This literature discusses the sequence of interarrival times X = (X1, X2, …) as an independent, identically distributed sequence of random variables. It assumes that X takes values in [0, ∞) and P(X > 0) > 0, so that the interarrival times are nonnegative, but not identically 0.
"Interarrival Time - an overview | ScienceDirect Topics"³. From the viewpoint of mathematical tractability, the negative-exponential interarrival or service-time distribution is the simplest, and fortunately these distributions serve as a good fit in many practical problems.
Two papers that resolve interarrival exponential time through hierarchical Bayesian:
"A hierarchical Bayesian entry time realignment method to study the long-term natural history of diseases"⁴⁵. This paper developed BETR (Bayesian entry time realignment), a hierarchical Bayesian method for investigating the long-term natural history of diseases using data from patients followed over short durations.
"Spatiotemporal Prediction Using Hierarchical Bayesian Modeling"⁶. This paper leverages the hierarchy of Bayesian models using the Gaussian process to predict long-term traffic status in urban settings.
Source: Conversation with Bing, 4/4/2024
Beta Was this translation helpful? Give feedback.
All reactions