Apple WWDC 2024 highlights: AI, platforms update, revamped Siri announced

Apple WWDC 2024 event highlights: Apple has unveiled new features coming with its next-generation platforms update, but most importantly announced Apple Intelligence for iPhones, iPads, and Macs

12:16 AM

Apple Intelligence: Support

Apple Intelligence coming to the iPhone 15 Pro and iPad and Macs with M1 and later.

12:16 AM

Apple Intelligence: More features

Rewriting tool

 

• To help you write specialised content with context awareness such as emails, resume, cover letters, etc.
• Support quick reply, which are called Smart Reply

 

Email

 

• Email summary
• Categorisations

 

Notes

• New tool called Image Wand to turn rough sketches into images, using Image Playgroung

 

Photos

 

• New “Clean Up” tool to make distracting objects in the background of photos disappear.
• Search in photos and videos now more powerful, with natural language search and the ability to find moments in the middle of video clips.

ChatGPT
 

• ChatGPT is integrated into Siri, Compose (with support for image generation). 
• When Apple Intelligence-powered tools such as revamped Siri wants to use ChatGPT, it will show a pop-up asking permission from user to send info to ChatGPT.
• ChatGPT integration coming later this year. "We also intend to add support for other AI models," says Craig.

12:14 AM

Revamped Siri: What's new

More natural, more relevant, and more personal.

Redesigned wake visual, which glows light that wrap arounds the device display

Siri to support text input, similar to other AI chatbots

Siri to have on-screen awareness

Siri will be able to take action in and across Apple native apps

Siri to drive context from personal content such as Photos, Messages, Calendar event, and more

12:13 AM

Apple Intelligence: What's new

• Personal intelligence system
• Apple Intelligence uses generative models, which are designed with privacy in mind
• Using Apple Intelligence, iPhones will prioritise notifications, help you write, summarise content, and condense text.
• Apple Intelligence is capable of generating images too, using photos in Photos library
• Apple Intelligence can take action across your apps and across Apple devices
• Apple Intelligence will be powered by on-device intelligence, which is available on the A17 Pro, and Apple Silicon starting from M1 chip
• Private Cloud Compute from Apple for specialised processing that needs to go on cloud

12:10 AM

Apple partners with OpenAI

• Siri voice assistant getting access to OpenAI's ChatGPT cahtbot
• Text generation, summarisation and more powered by ChatGPT 
• ChatGPT integration coming later this year

12:06 AM

Apple Intelligence: Image generation

• Genmoji: AI generated emojis
• Image Playground: AI generated images using pictures, themes without any prompt
• Image Playground is built into native apps and also has a seperate app too
• Image Wand for Apple Pencil: Ai generated images within notes using gestures 
• AI powered object eraser for photos
• AI powered image search in Photos

11:59 PM

Apple Intelligence: Writing tools

• Rewrite feature in for AI powered text suggestions and generation with tone understanding
• Proofreed text content
• Key point generation with text summarisation capability
• Email summaries on inbox in Mail app
• Auto-prioritising emails using AI
• Notification summaries

11:54 PM

Apple Intelligence: Siri voice assistant

• New design
• Deepely integrated into the system
• Natural language understanding
• Contextual understanding
• Type-in request support
• Improved knowledge about Apple devices like iPhones, iPads, Airtags and more
• On-screen understanding 
• Support for in-app actions 
• AI image editing
• Can work with third-party apps too
• Personal contextual understanding

11:46 PM

Apple Intelligence: Architecture

Apple Intelligence leverages Apple silicon to process data on-device for privacy
Private Cloud Compute for processing more complex requests on cloud
Hybrid nature: It decides if the data can be processed on-device or should be sent to Cloud for better results

11:43 PM

Apple intelligence: Apple's own AI is here

Capabilities:

• Natural language understanding for text generation, summarisation and more
• Personalised image generation within Notes, Pages and more native apps
• Apple Intelligence is capable of taking actions within apps
• It can process personal data on-device for understanding the context

11:37 PM

Safari: What's new

• World’s fastest browser with focus on privacy and security
• Safari now has highlights, which uses machine learning to automatically detect interesting things and show it to you with just a click.
• Reader mode now has summaries and table of contents.
• Viewer lets you bring videos front and center with system video controls.

11:36 PM

macOS Sequoia: What's new

• Continuity – to boosts Apple ecosystem.
• Wireless iPhone mirroring to see and control iPhone remotely using mac. iPhone notifications will appear alongside mac notifications. Audio is redirected to mac, too. Mirroring works even with the iPhone locked. Supports drag-and-drop functions.
• Tile position to quickly place windows side by side, just like Windows
• Built-in background replacements now available for FaceTime and Zoom
• Passwords app coming to mac, iPad, and iPhone, and Windows

11:34 PM

Assassins Creed Shadows on Macs and iPads

French videogame developer Ubisoft announces that Assassins Creed Shadows is coming to Apple silicon powered Macs and iPads along with PCs and gaming console in November this year

11:32 PM

iPadOS 18: What's new

• Floating tab bar, which is customisable and can move into a side bar
• SharePlay now lets you remote control someone else iPad
• Calculator app is coming to iPad – supports Apple Pencil
• Smart Script coming to Notes app. It will make handwriting smoother, using on-device machine learning, to make your handwriting better. Smoother, straighter, and more legible.
• Pasted text now appears in handwritten notes format
• Supports spell check, text wrap, and copy/paste functions

11:31 PM

WatchOS 11: What's new

• Training load for enthusiasts and training athletes
• Vitals app to quickly view vital health metrics at one place
• New features for cycle tracking — pregnancy tracking features
• WatchOS smart stacks automatically adds widgets like weather and translation
• Check-in coming to Apple Watch

 

11:31 PM

Apple MacOS Sequoia

• Math Notes support
• Hike features on Maps
• iPhone mirroring on Macs with Continuity
• iPhone notifications on Macs
• Auto tile positioning for multitasking
• built-in backgrounds for video calls
• New Paswords app for storing and organising passwords, security keys and more
• Password app will be available on iPad and iPhones too
• Highlights that uses Machine learning for suggestions on Safari browser
• Text summarisation feature on Safari

11:21 PM

Apple iPadOS 18: iPad is getting a Calculator app

• Floating tab bars for easier access within Apps like Keynote, Pages and more
• New smoother animations
• Drawing gesture support on SharePlay
• iPad is getting its maiden calculator app
• Math Notes feature on calculator app for solving complex equations using Apple Pencil
• Real time graph generation on Math Notes
• Notes app getting Math Notes feature
• Smart Script in Notes with on-device AI for better handwriting and more

11:13 PM

Apple WatchOS 11: Intelligent Widgets

Intelligent widgets that automatically appears on the Watch showing key data that the user might need at that time. It uses machine learinging data to suggest and show these key widgets on the Apple Watch

11:11 PM

Apple WatchOS 11: Health

Training Load data insights
Summary page customisation
New Vitals app for key health metric insights

11:07 PM

Apple iOS 18: What’s new

Home screen

 

• Apps and widgets can now be relocated on screen
• New app icons in dark mode
• Home screen is now customisable for colours

 

Control Center

 

• New group of controls, which pops-up with a swipe-up gesture
• Shows connected home devices
• Controls Gallery to add/remove group of controls
• Controls are also available from lock screen
• Action button integration to invoke controls

 

Lock an app

 

• Independent app lock
• Hide app, which goes into Hidden app folder that is locked

 

Messages

• RCS messaging support
• Tapbacks: Use any emojis and stickers
• Schedule message for send later
• Text formatting with options to italicise, bold, and more
• Text effects now integrated
• Messages via Satellite – iPhone 14 and later – key iMessage
• feature only

 

Mail

 

• On-device categorisation – Primary, Transactions, Updates,
• Promotions (later this year)

 

Maps, Wallet, Journal app also get new features. Game mode

is coming to iPhone.

 

Photos 

• Biggest redesign ever
• Makes it easier to find memories
• Feels familiar, but a unified view makes it easy to access
• the library
• Intelligence is built-in to create collections, which
• categorises photos based on memories, trips, etc.
• Photos is customisable for collections

11:04 PM

Apple AirPods update

• Head movement gesture controls for Siri
• Voice isolation during calls for AirPods Pro
• Personalised Spatial Audio support for games

11:01 PM

Apple iOS 18: RCS messaging

RCS messaging support will be coming to iPhones with iOS 18

11:01 PM

Apple iOS 18: Photos App

• New design with better organisation
• Months and Years filters for searching photos
• Collection feature for browsing photos with topics
• Trip sections for organising photos based on locations
• Customisable Collections 
• New design to Favourite and Featured photos

10:57 PM

Apple iOS 18: Game Mode

Mac's Game mode is coming to iPhones

10:56 PM

Apple iOS 18: Wallet

• Tap to Cash feature for payments
• New app design

10:55 PM

Apple iOS 18: Mails

• email sorting options like Promotions and Updates
• email categorisation

10:54 PM

Apple iOS 18: Messages

• More Tapback options with emojis
• Text formating like Itallics and Strike through
• New Text effects
• Messages via Satellite for sending and receiving messages over satellite connectivity
• SMS over satellite

10:51 PM

Apple iOS 18: Privacy

• Lock an App option with biometric authentication for opening specific apps
• New Hidden app folder
• Limited access to contacts for apps

10:49 PM

Apple iOS 18: Control Center

• New Home Control options
• Control Gallery
• Controls from Lock Screen and Action Button

10:47 PM

Apple iOS 18: Home Screen

New Home Screen personalisation options

• Place apps anywhere on the Home Screen
• New Dark Mode icons for apps
• Tint colour for app icons