When Apple Intelligence launched final 12 months, Apple promised us that its AI system would revolutionize how we use our gadgets. Sadly, this previous 12 months has been way more middling than miraculous for Apple’s AI, with the platform failing to impress within the methods we had been hoping.
Meaning there are loads of methods Apple Intelligence might be improved sooner or later. From improved automation to extra highly effective enhancing instruments and past, Apple’s AI basis opens up a world of potentialities for bringing new good instruments to our Apple gadgets. Listed below are 10 of the highest options we’d like to see within the subsequent model of Apple Intelligence.
Apple Intelligence 2.0: Quick enhancements
Picture era
Apple’s Picture Playground app is a enjoyable solution to shortly create quirky photographs, but it surely’s nonetheless very restricted and rudimentary, particularly whenever you evaluate it to rival AI mills reminiscent of Steady Diffusion and GPT-4o Picture Era.
For starters, Apple wants to repair these persistent bugbears that appear to afflict virtually all AI mills, issues like freakishly inaccurate fingers and ft. However the enhancements have to transcend that if Picture Playground is to achieve traction. We want much more management and adaptability over the photographs it whips up. Meaning with the ability to import new era fashions and kinds, the flexibility to work with totally different side ratios, modify the relative energy of every immediate, and extra.
It’s uncertain Apple will give us the flexibility to make phot-realistic photographs, however there’s nonetheless loads Picture Playground can do to reinforce its generated artwork. For instance, the latest OpenAI GPT-4o mannequin replace allowed customers to attract photographs within the type of a Studio Ghibli Japanese animation movie. It was a viral sensation when it launched and precisely the form of factor Picture Playground must get some buzz.
Picture Playground gives rudimentary picture creation at greatest and must be significantly better.
Foundry
Photograph enhancing
Talking of photographs, Apple has introduced a number of AI picture enhancing instruments to our gadgets, but these will also be vastly improved. Within the first model of Apple Intelligence, we will take away distractions in pictures utilizing Apple Intelligence’s Clear Up device, for instance, however having the choice to add components to your photos can be a enjoyable additional. This might prolong to refining current components of your photographs, reminiscent of changing one sort of tree with one other in a panorama.
We’d additionally prefer to get the facility to take away one thing from one picture and add it to a different. Or to summon Siri and use pure language to make edits. Think about how a lot problem you may save by merely saying, “Hey Siri, change this sky to a thunderous rainstorm.”
Foundry
Apple Intelligence 2.0: Foundational upgrades
Pure language search
One of many key concepts behind synthetic intelligence is that it’s going to simplify your day-to-day life. So why isn’t Apple Intelligence excellent at doing that? One key method it may enhance is by including extra pure language capabilities.
This might be actually efficient if it was added to issues like Highlight search or the Messages app. We must always be capable to open Highlight or Siri and ask, “Present me pictures I took between August 3 and 5.” Proper now, that doesn’t work. Highlight brings up photographs, certain, however solely those who include the textual content you typed. With somewhat sprinkling of Apple Intelligence, these searches might be way more helpful.
On-device search must be the inspiration of Apple intelligence.
Foundry
Apple LLM
One of many extra evident examples of Apple intelligence’s ineptitude is Siri’s integration with ChatGPT, which has the unlucky impact of straight evaluating Apple’s AI engine with a much more superior system. The comparability will not be precisely flattering to Apple’s toddler AI efforts.
What we actually want is for Apple to launch its personal LLM to compete with the likes of ChatGPT. For one factor, this may inject much more energy into Apple Intelligence’s engines and permit it to face toe-to-toe with the business’s greatest platforms. For one more, it might higher protect your privateness, since you may keep within the Apple intelligence sphere with out venturing off into less-secure cloud-based options. With an Apple LLM behind the wheel, there can be no want to change to different AI instruments, which might hold your workflow easy and uninterrupted.
Rumors have prompt that this sort of Apple-backed LLM is within the works, however we don’t know when it’d arrive. When it will definitely does drop, it might be the jump-start Apple Intelligence must hold tempo with its rivals.
Shortcuts
Apple’s Shortcuts app is among the greatest instruments obtainable in your iPhone, but I’d wager most individuals have by no means even opened it. A part of the issue is that Apple solely covers essentially the most primary of duties, so that you’re by yourself if you wish to run extra advanced workflows.
It is a place the place Apple Intelligence may step in to fill the hole. If AI was built-in into Shortcuts in order that you may merely inform it what you wish to do, Shortcuts would immediately go from an underused utility to probably the greatest iPhone options ever. As one of many foremost tenets of Apple intelligence, Shortcuts may counsel easy time-saving shortcuts all through the day like Siri ideas, and switch your iPhone into a real digital assistant.
Computerized Shortcuts might be a unbelievable solution to set Apple Intelligence other than its rivals.
Foundry
Well being and health
Well being and health monitoring has been one in every of Apple’s priorities lately, with the Apple Watch main the way in which. There’s loads of well being information stashed on our gadgets, and there are many ways in which Apple’s AI may assist enhance well being and health with out compromising privateness. There are already rumors that Apple is engaged on an AI “coach” to interpret the information collected by your gadgets and provide you with a extra full image of your well being.
Such a platform may present itself in optimized exercises with Apple Intelligence crunching your health numbers after which constructing a customized exercise plan primarily based in your wants. Or specialised HIIT exercises, Pilates, weight coaching, or no matter it thinks you might want to take your health to the following degree.
Apple
Apple Intelligence 2.0: New options
Movies
Apple Intelligence is already getting used to edit photographs on our iPhones, however what if it may apply its expertise to movies as nicely? The iPhone is already one of many prime video telephones round and AI may take it to the following degree.
Maybe that might imply creating an inventory of prompt edits for any undertaking you feed into it. Or the facility to take away distractions from movies in the identical method you may at the moment do with photographs. Maybe even automated colour grading and audio mixing might be added.
After all, Apple will likely be very cautious about treading on video enhancing – in spite of everything, it in all probability doesn’t wish to indicate it’s coming after the artistic industries after the Crush! advert fiasco – however a number of useful instruments for newbie editors to play with on their iPhones can be a welcome addition.
Notes
One of many ways in which Apple tried to display Apple Intelligence’s energy at WWDC 2024 was via transcribing audio within the Notes app. Sadly, that is neither a groundbreaking characteristic nor one which’s even on par with rival AI platforms. It would work nicely for easy voice memos, however something with a couple of speaker shortly turns into a jumbled mess.
There’s a fast method Apple can repair this by educating Apple Intelligence routinely label audio system—in spite of everything, companies reminiscent of Otter and the tiny unbiased MacWhisper app have been doing it for years.
Apple’s Notes app does a fantastic job of transcribing with Apple Intelligence, but it surely’s not but good sufficient to tell apart between totally different audio system.
Apple
Maps
Over time, Apple Maps has improved a lot that many iPhone customers now desire it over Google Maps. However as an alternative of Apple working a victory lap, Apple can use AI to reinforce Maps even additional.
For the time being, you may search Apple Maps for issues like eating places and outlets close to you. However I would like greater than that – I would like to have the ability to ask Apple Maps for “one of the best eating places close to me” and solely see the highest-rated ones. Or seek for eateries that serve meals with particular components (that is at the moment very hit-and-miss). Or discover out the place one of the best viewpoints are in my metropolis (once more, that is unreliable). Apple Maps struggles with that proper now, however maybe Apple Intelligence would assist it get there.
Apple Intelligence may assist with instructions. Siri is already fairly good at getting us from Level A to Level B, however as with a lot of Siri’s present options, it’s nonetheless disappointingly restricted to locations and addresses. Apple Intelligence may step in right here to make it extra highly effective. For instance, you may ask Siri to “get me house utilizing essentially the most eco-friendly route,” or “create a round strolling route within the countryside close to me.” Weaving extra AI into the combination may make these requests extra achievable for Apple’s digital assistant.
With somewhat Apple Intelligence, Maps may be a lot extra helpful.
Apple
Dwelling
Apple is closely rumored to be getting in on the good house act with a brand new HomePad hub machine reportedly launching later this 12 months and early subsequent, and Apple Intelligence will virtually actually tackle a central function in the way you work together with it. However
You may sooner or later use Apple Intelligence to research the related gadgets in your good house to work out how you may get monetary savings on electrical energy payments or scale back your carbon footprint. And with rumors swirling that Apple is engaged on a collection of good house hubs, it’s attainable that these capabilities will seem on the horizon sooner relatively than later.
