Overview
Suffolk is prioritizing data and analytics at the forefront of our growth strategy. As our CEO, John Fish says, “if you can’t measure it, you can’t manage it.” As we continue to grow and expand our data strategy, we are always looking for the top technology and partners to level us up. We quickly identified Toric as a perfect fit for us to help with our raw data ingestion. Before Toric, we could only retrieve Procore data at eight-hour intervals, which greatly delayed our data reporting. With Toric, we can extract Procore data and even compare the differences between data sets in minutes to effectively get real-time updates anytime there is a project change.
“Having real-time data from Toric is allowing both our internal and external stakeholders to see their data updating live, which they are extremely excited about. In addition, the Toric tool has a great user experience and is an excellent addition to my engineering workflow.”
Amanda Moulaison Data Engineer, Suffolk Construction
Challenge
Getting Procore project data using our existing solution was slow and nowhere near real-time. Additionally, the dynamic nature of the Procore API made our solution very fragile - it broke frequently and these breaks were difficult and time-consuming to debug. In addition to giving us real-time data, Toric is also reducing the workload on our engineering team.
With our original Procore data ingestion pipeline, we frequently spent several hours per week debugging issues and trying to keep up with the changing Procore API. This forced us to be reactive instead of proactive, which made it difficult to be agile with this data.
Because our original ingestion solution was such a heavy lift on our engineering team, we had to prioritize and select which Procore endpoints to ingest. As a result of this, we weren’t able to pull in any tables that weren’t absolutely required due to time constraints. Now, because Toric has eased our engineering burden, we’re able to ingest and process all available Procore data tables. This in turn allows us to present more data points in our downstream dashboards and analytics, creating richer insights for our stakeholders.
Lastly, my team and I love Toric because it’s data ingestion pipeline fits seamlessly into our existing data engineering workflow. Our pipeline leverages AWS S3 and Databricks to store and process our raw data before it lands in an AWS Redshift database to be used by our analysts and data scientists.
It was simple to set up our Toric pipelines to drop off our Procore data in S3 - just like our other existing data flows.
Solution
Switching to Toric has also not only helped our engineering team - our data analysts, data scientists, and even our stakeholders see and appreciate its benefits. We use Toric to pull data from our Procore Projects to gain real-time project data using a solution that integrates with our existing data stack and automates data extraction.
In our Toric data ingestion pipeline, we were able to implement the Diff Node feature. This functionality instantly showcases the differences in a data set across time intervals by marking each record as “new”, “updated”, or “deleted.” This makes it much easier for our analysts to track and report on the ongoing progress of any project.
Our stakeholders are enjoying seeing real-time data updates in their Tableau and Power BI dashboards and other analytics tools. In fact, the seamless and instantaneous nature of Toric data ingestion pipelines has led our team to investigate introducing new data tools to our company, such as installing interactive touch-screen displays throughout our office to display analytics and trending data.
Result
Our team’s original Procore data ingestion solution met our minimal needs by processing and delivering our highest-priority data at daily intervals.
Since switching to Toric, we can’t imagine going back. Toric has significantly eased the burden on our engineering team, which has increased our bandwidth and allowed us to focus on new projects and integrations. This process has saved our data team valuable time, and now our organization can make better-informed decisions faster, thanks to Toric.
Since completing our Procore data ingestion pipeline buildout, we have begun exploring the opportunity to leverage Toric for other data integrations as well, including Oracle Primavera and Revit. To learn more, visit toric.com.
{View PDF}
To learn more, register for the 2/18 data leader panel feat. Jit Kee Chin
Chief Data & Innovation Officer at Suffolk Construction
*Authors note
Prior to joining the construction industry, I worked for a few years as a data scientist at several different pharmaceutical companies. In pharma, the data is typically very clean - highly regulated, cleanly formatted, clearly defined “acceptable ranges” - not a decimal point out of place. Truly any data scientist’s dream.
You can imagine the shock I experienced when I joined the construction industry as a data engineer and discovered the deep complexity of construction data! Endless parameters, free text fields, and a seemingly infinite trickle of data points were coming in from so many sources.
Related Stories
Multifamily Housing | Jun 28, 2023
Sutton Tower, an 80-story multifamily development, completes construction in Manhattan’s Midtown East
In Manhattan’s Midtown East, the construction of Sutton Tower, an 80-story residential building, has been completed. Located in the Sutton Place neighborhood, the tower offers 120 for-sale residences, with the first move-ins scheduled for this summer. The project was designed by Thomas Juul-Hansen and developed by Gamma Real Estate and JVP Management. Lendlease, the general contractor, started construction in 2018.
Apartments | Jun 27, 2023
Dallas high-rise multifamily tower is first in state to receive WELL Gold certification
HALL Arts Residences, 28-story luxury residential high-rise in the Dallas Arts District, recently became the first high-rise multifamily tower in Texas to receive WELL Gold Certification, a designation issued by the International WELL Building Institute. The HKS-designed condominium tower was designed with numerous wellness details.
K-12 Schools | May 25, 2023
From net zero to net positive in K-12 schools
Perkins Eastman’s pursuit of healthy, net positive schools goes beyond environmental health; it targets all who work, teach, and learn inside them.
Office Buildings | May 15, 2023
Sixteen-story office tower will use 40% less energy than an average NYC office building
This month marks the completion of a new 16-story office tower that is being promoted as New York City’s most sustainable office structure. That boast is backed by an innovative HVAC system that features geothermal wells, dedicated outdoor air system (DOAS) units, radiant heating and cooling, and a sophisticated control system to ensure that the elements work optimally together.
Office Buildings | May 4, 2023
In Southern California, a former industrial zone continues to revitalize with an award-winning office property
In Culver City, Calif., Del Amo Construction, a construction company based in Southern California, has completed the adaptive reuse of 3516 Schaefer St, a new office property. 3516 Schaefer is located in Culver City’s redeveloped Hayden Tract neighborhood, a former industrial zone that has become a technology and corporate hub.
Mass Timber | May 3, 2023
Gensler-designed mid-rise will be Houston’s first mass timber commercial office building
A Houston project plans to achieve two firsts: the city’s first mass timber commercial office project, and the state of Texas’s first commercial office building targeting net zero energy operational carbon upon completion next year. Framework @ Block 10 is owned and managed by Hicks Ventures, a Houston-based development company.
| Apr 28, 2023
$1 billion mixed-use multifamily development will add 1,200 units to South Florida market
A giant $1 billion residential project, The District in Davie, will bring 1.6 million sf of new Class A residential apartments to the hot South Florida market. Located near Ft. Lauderdale and greater Miami, the development will include 36,000 sf of restaurants and retail space. The development will also provide 1.1 million sf of access controlled onsite parking with 2,650 parking spaces.
Mixed-Use | Apr 27, 2023
New Jersey turns a brownfield site into Steel Tech, a 3.3-acre mixed-use development
In Jersey City, N.J., a 3.3-acre redevelopment project called Steel Tech will turn a brownfield site into a mixed-use residential high-rise building, a community center, two public plazas, and a business incubator facility. Steel Tech received site plan approval in recent weeks.
Multifamily Housing | Apr 19, 2023
Austin’s historic Rainey Street welcomes a new neighbor: a 48-story mixed-used residential tower
Austin’s historic Rainey Street is welcoming a new neighbor. The Paseo, a 48-story mixed-used residential tower, will bring 557 apartments and two levels of retail to the popular Austin entertainment district, known for houses that have been converted into bungalow bars and restaurants.
Design Innovation Report | Apr 19, 2023
Reinforced concrete walls and fins stiffen and shade the National Bank of Kuwait skyscraper
When the National Bank of Kuwait first conceived its new headquarters more than a decade ago, it wanted to make a statement about passive design with a soaring tower that could withstand the extreme heat of Kuwait City, the country’s desert capital.
