This report presents the findings of an independent evaluation of the Freight Information Real-time System for Transport (FIRST) intermodal freight ITS prototype system. FIRST is an Internet-based, real-time network that integrates numerous sources of freight location and status into a single, easily navigated Web portal to allow port users to access cargo and Port information to facilitate planning and logistics. This system was designed by the Port Authority of New York and New Jersey, in cooperation with members of the private sector intermodal industry, to meet the operational needs of regional intermodal freight service providers and their customers. FIRST makes information from ocean carriers, terminal operators, rail lines, and trucking companies available to port users. These stakeholders envisioned the FIRST system would help to reduce the truck queues at terminal gates, reduce unnecessary trips by trucks to the port, reduce truck emissions, increase terminal operation efficiencies, and improve the freight transportation system at the Port of New York/New Jersey overall. However, due to a variety of internal and external factors, the FIRST system did not gain a significant level of usage over the course of the evaluation period. For this reason the aforementioned benefits did not occur. This evaluation presents some of the factors contributing to the low usage, compares FIRST to similar, yet successful systems, and demonstrates via simulation the benefits that might be realized should the FIRST system incorporate a truck appointment system.