Market Opening Notifications

Imagine you're working at Robinhood, where an experiment was conducted to assess the impact of sending push notifications to users at the start of each trading day. These reminders were sent to 1,000,000 active users who had the app installed for at least four days before the experiment began, aiming to mitigate risk. Results from the experiment are as follows: | Metric | Impact | P-Value | |-------------------------|---------|--------| | D1_TradingRev/User | +0.12% | 0.1723 | | D1_OtherRev/User | +0.20% | 0.2992 | | D1_Revenue/User | +0.32% | 0.0475 | | Daily_Sessions/User | +1.98% | 0.0022 | | D14_NetPromoterScore | -0.22% | 0.2021 | | D1_Retention | +0.03% | 0.0495 | | D7_Retention | +0.01% | 0.1023 | | D14_Retention | -0.02% | 0.0819 | | D1_TimeSpent/ActiveUser | +0.32% | 0.1456 | | D7_TimeSpent/ActiveUser | +0.64% | 0.0921 | | D14_TimeSpent/ActiveUser | +0.92% | 0.0433 | | D1_TimeSpentPerDay/ActiveUser | +0.91% | 0.0644 | Identify which metrics are statistically significant based on the provided data. Discuss your criteria for significance. Additionally, provide your recommendation on whether Robinhood should implement these notifications across their entire user base, with supporting reasons.