Tag: Dell Inc.

  • Dell Aims to Be the Go-To Source for Enterprise AI Infrastructure

    Dell Aims to Be the Go-To Source for Enterprise AI Infrastructure

    Michael Dell is pitching a “decentralized” future for artificial intelligence that his company’s devices will make possible.   

    “The future of AI will be decentralized, low-latency, and hyper-efficient,” predicted the Dell Technologies founder, chairman, and CEO in his Dell World keynote, which you can watch on YouTube. “AI will follow the data, not the other way around,” Dell said at Monday’s kickoff of the company’s four-day customer conference in Las Vegas.

    Dell is betting that the complexity of deploying generative AI on-premise is driving companies to embrace a vendor with all of the parts, plus 24-hour-a-day service and support, including monitoring.

    On day two of the show, Dell chief operating officer Jeffrey Clarke noted that Dell’s survey of enterprise customers shows 37% want an infrastructure vendor to “build their entire AI stack for them,” adding, “We think Dell is becoming an enterprise’s ‘one-stop shop’ for all AI infrastructure.”

    Dell’s new offerings include products meant for so-called edge computing, that is, inside customers’ premises rather than in the cloud. For example, the Dell AI Factory is a managed service for AI on-premise, which Dell claims can be “up to 62% more cost-effective for inferencing LLMs on-premises than the public cloud.”

    dell poweredge
    Dell Technologies

    Dell brands one offering of its AI Factory with Nvidia to showcase the chip giant’s offerings. That includes, most prominently, revamped PowerEdge servers, running as many as 256 Nvidia Blackwell Ultra GPU chips, and some configurations that run the Grace-Blackwell combination of CPU and GPU.

    Future versions of the PowerEdge servers will support the next versions of Nvidia CPU and GPU, Vera and Rubin, said Dell, without adding more detail. 

    Dell also unveiled new networking switches running on either Nvidia’s Spectrum-X networking silicon or Nvidia’s InfiniBand technology. All of these parts, the PowerEdge servers and the network switches, conform to the standardized design that Nvidia has laid out as the Nvidia Enterprise AI factory.

    A second batch of updated PowerEdge machines will support AMD’s competing GPU family, the Instinct MI350. Both PowerEdge flavors come in configurations with either air cooling or liquid cooling.

    Complementing the Factory servers and switches are data storage enhancements, including updates to the company’s network-attached storage appliance, the PowerScale family, and the object-based storage system, ObjectScale. Dell introduced what it calls PowerScale Cybersecurity Suite, software designed to detect ransomware, and what Dell calls an “airgap vault” that keeps immutable backups separate from production data, to “ensure your critical data is isolated and safe.” 

    The ObjectScale products gain support for remote data access (RDMA), for use with Amazon’s S3 object storage service. The technology more than triples the throughput of data transfers, said Dell, lowers the latency of transfers by 80%, and can reduce the load on CPUs by 98%.

    “This is a game changer for faster AI deployments,” the company claimed. “We’ll leverage direct memory transfers to streamline data movement with minimal CPU involvement, making it ideal for scalable AI training and inference.”

    Dell AI Factory also emphasizes the so-called AI PC, workstations tuned for running inference. That includes a new laptop running a Qualcomm circuit board, the AI 100 PC inference card. It is meant to make local predictions with Gen AI without having to go to a central server. 

    dell pro max plus 3
    Dell Technologies

    The Dell Pro Max Plus laptop is “the world’s first mobile workstation with an enterprise-grade discrete NPU,” meaning a standalone chip for neural network processing, according to Dell’s analysis of workstation makers.

    qualcomm discrete npu in exploded dell pro max plus in datacenter
    Dell Technologies
    qualcomm discrete npu
    Dell Technologies

    The Pro Max Plus is expected to be available later this year.

    A number of Dell software offerings were put forward to aid the idea of the decentralized, “disaggregated” AI infrastructure. 

    For example, the company made an extensive pitch for its file management software, Project Lightning, which it calls “the world’s fastest parallel file system per new testing,” and which it said can achieve “up to two times greater throughput than competing parallel file systems.” That’s important for inference operations that must rapidly intake large amounts of data, the company noted.

    Also in the software bucket is what Dell calls its Dell Private Cloud software, which is meant to move customers between different software offerings for running servers and storage, including Broadcom’s VMware hypervisors, Nutanix’s hyper-converged offering, and IBM Red Hat’s competing offerings. 

    The company claimed Dell Private Cloud’s automation capabilities can allow customers to “provision a private cloud stack in 90% fewer steps than manual processes, delivering a cluster in just two and a half hours with no manual effort.”

  • Trump introduces tariff exemptions for electronics, including smartphones and computers.

    Trump introduces tariff exemptions for electronics, including smartphones and computers.

    After more than a week of ratcheting up tariffs on products imported from China, the Trump administration issued a rule late Friday that spared smartphones, computers, semiconductors and other electronics from some of the fees, in a significant break for tech companies like Apple and Dell and the prices of iPhones and other consumer electronics.

    message posted late Friday by U.S. Customs and Border Protection included a long list of products that would not face the reciprocal tariffs President Trump imposed in recent days on Chinese goods as part of a worsening trade war. The exclusions would also apply to modems, routers, flash drives and other technology goods, which are largely not made in the United States.

    The exemptions are not a full reprieve. Other tariffs will still apply to electronics and smartphones. The Trump administration had applied a tariff of 20 percent on Chinese goods earlier this year for what the administration said was the country’s role in the fentanyl trade. And the administration could still end up increasing tariffs for semiconductors, a vital component of smartphones and other electronics.

    The moves were the first major exemptions for Chinese goods, which would have wide-ranging implications for the U.S. economy if they persist. Tech giants such as Apple and Nvidia would largely sidestep punitive taxes that could slash their profits. Consumers — some of whom rushed to buy iPhones this past week — would avoid major potential price increases on smartphones, computers and other gadgets. And the exemptions could dampen additional inflation and calm the turmoil that many economists feared might lead to a recession.

    The tariff relief was also the latest flip-flop in Mr. Trump’s effort to rewrite global trade in a bid to boost U.S. manufacturing. The factories that churn out iPhones, laptops and other electronics are deeply entrenched in Asia — especially in China — and are unlikely to move without a galvanizing force like the steep taxes that the Trump administration had proposed.

    “It’s difficult to know if there’s a realization within the administration that reworking the American economy is a gargantuan effort,” said Matthew Slaughter, the dean of the Tuck School of Business at Dartmouth. 

    The electronics exemptions apply to all countries, not just China. 

    Still, any relief for the electronics industry may be short-lived, since the Trump administration is preparing another national security-related trade investigation into semiconductors. That will also apply to some downstream products like electronics, since many semiconductors come into the United States inside other devices, a person familiar with the matter said. These investigations have previously resulted in additional tariffs.

    Karoline Leavitt, the White House spokeswoman, said in a statement on Saturday that Mr. Trump was still committed to seeing more of these products and components made domestically. “President Trump has made it clear America cannot rely on China to manufacture critical technologies” and that at his direction, tech companies “are hustling to onshore their manufacturing in the United States as soon as possible,” she said.

    A senior administration official, speaking on background because they were not authorized to speak publicly, said that Friday’s exemptions were aimed at maintaining America’s supply of semiconductors, a foundational technology used in smartphones, cars, toasters and dozens of other products. Many cutting-edge semiconductors are manufactured overseas, such as in Taiwan.

    Paul Ashworth, the chief North America economist for Capital Economics, said the move “represents a partial de-escalation of President Trump’s trade war with China.”

    He said the 20 product types that were exempted on Friday account for nearly a quarter of U.S. imports from China. Other countries in Asia would be even bigger winners, he said. Should the tariffs on those countries kick in again, the exemption would cover 64 percent of U.S. imports from Taiwan, 44 percent of imports from Malaysia and nearly a third of imports from both Vietnam and Thailand, he said.

    The changes punctuated a wild week in which Mr. Trump backtracked from many tariffs he introduced on April 2, which he had called “liberation day.” His so-called reciprocal tariffs had introduced taxes that would reach up to 40 percent on products imported from some nations. After the stock and bond markets plunged, Mr. Trump reversed course and said he would pause levies for 90 days.

    China was the one exception to Mr. Trump’s relief because Beijing chose to retaliate against U.S. tariffs with levies of its own. Instead of pausing tariffs on Chinese imports, Mr. Trump increased them to 145 percent and showed no willingness to spare any companies from those fees. In return, China on Friday said it was raising its tariffs on American goods to 125 percent.

    That sent shares of many technology companies into free fall. Over four days of trading, the valuation of Apple, which makes about 80 percent of its iPhones in China, fell by $773 billion.

    For now, Mr. Trump’s moderation is a major relief for a tech industry that has spent months cozying up to the president. Meta, Amazon and several tech leaders donated millions to President Trump’s inauguration, stood behind him as he was sworn into office in January and promised to invest billions of dollars in the United States to support him.

    Tim Cook, Apple’s chief executive, has been at the forefront of the industry’s courtship of Mr. Trump. He donated $1 million to Mr. Trump’s inauguration and later visited the White House to pledge that Apple would spend $500 billion in the United States over the next four years.

    The strategy repeated Mr. Cook’s tactics during Mr. Trump’s first term. To head off requests that Apple begin manufacturing its products in the United States rather than China, Mr. Cook cultivated a personal relationship with the president that helped Apple win exemptions on tariffs for its iPhones, smartwatches and laptops.

    It had been unclear if Mr. Cook could obtain a similar break this time, and the tariffs Mr. Trump proposed were more severe. As the Trump administration increased its taxes on Chinese goods, Wall Street analysts said Apple might have to increase the price of its iPhones from $1,000 to more than $1,600.

    The threat of higher iPhone prices caused some Americans to rush to Apple stores to buy new phones. Others raced to buy computers and tablets that were made in China.

    Apple did not immediately respond to a request for comment.

    Apple’s iPhone quickly became a symbol of the tit-for-tat over tariffs with China. On Sunday, Commerce Secretary Howard Lutnick appeared on CBS’s “Face the Nation” and said the tariffs would result in an “army of millions and millions of people screwing in little, little screws to make iPhones” in the United States. Ms. Leavitt said later in the week that Mr. Trump believed that the United States had the resources to make iPhones for Apple.

    “Apple has invested $500 billion here in the United States,” she said. “So if Apple didn’t think the United States could do it, they probably wouldn’t have put up that big chunk of change.”

    Apple has faced questions about moving some iPhone manufacturing to the United States for more than a decade. In 2011, President Obama asked Steve Jobs, Apple’s co-founder, what it would take to make the company’s best-selling product in the United States rather than China. In 2016, Mr. Trump also pressured Apple to change its position.

    Mr. Cook has remained steadfast in his commitment to China and has said the United States doesn’t have enough skilled manufacturing workers to compete with China.

    “In the U.S., you could have a meeting of tooling engineers, and I’m not sure we could fill the room,” he said at a conference in late 2017. “In China, you could fill multiple football fields.”

    Additional tariffs on semiconductors and other electronics could come in the next few weeks or months. The administration has signaled it is considering such tariffs under a legal statute known as Section 232, alongside other tariffs on imported pharmaceuticals.

    The president has already used the statute to put a 25 percent tariff on imported steel, aluminum and automobiles, and is weighing similar steps for imported lumber and copper. All of those sectors were given exemptions from the so-called reciprocal tariffs that the president announced on April 2.

    Speaking to reporters the next day, the president said that other tariffs on chips would be “starting very soon,” adding that the administration was also looking at tariffs on pharmaceuticals. “We’ll be announcing that sometime in the near future,” he said. “It’s under review right now.”

    The other tariffs that the Trump administration has applied through Section 232 investigations have been set at 25 percent — much lower than the 145 percent tariff currently in place for many products from China.